Jul 14 17:43:33 devstack cinder-volume[76193]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 14 17:43:33 devstack cinder-volume[76193]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 14 17:43:33 devstack cinder-volume[76193]: we strongly recommend against using it for new projects.
Jul 14 17:43:33 devstack cinder-volume[76193]: If you are already using Eventlet, we recommend migrating to a different
Jul 14 17:43:33 devstack cinder-volume[76193]: framework.  For more detail see
Jul 14 17:43:33 devstack cinder-volume[76193]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 14 17:43:33 devstack cinder-volume[76193]:   import eventlet  # noqa
Jul 14 17:43:36 devstack cinder-volume[76193]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76193) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 17:43:36 devstack cinder-volume[76193]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76193) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 17:43:36 devstack cinder-volume[76193]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76193) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 17:43:37 devstack cinder-volume[76193]: INFO dbcounter [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Registered counter for database cinder
Jul 14 17:43:37 devstack cinder-volume[76193]: DEBUG oslo_db.sqlalchemy.engines [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76193) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:43:37 devstack cinder-volume[76193]: DEBUG dbcounter [-] [76193] Writer thread running {{(pid=76193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 14 17:43:37 devstack cinder-volume[76193]: INFO cinder.rpc [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 14 17:43:37 devstack cinder-volume[76193]: INFO cinder.rpc [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 14 17:43:37 devstack cinder-volume[76193]: DEBUG oslo_db.sqlalchemy.engines [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76193) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:43:37 devstack cinder-volume[76193]: INFO cinder.volume.manager [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Determined volume DB was empty at startup.
Jul 14 17:43:37 devstack cinder-volume[76193]: DEBUG cinder.volume.manager [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76193) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 14 17:43:37 devstack cinder-volume[76193]: INFO cinder.volume.manager [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 14 17:43:37 devstack cinder-volume[76193]: WARNING stevedore.named [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 14 17:43:37 devstack cinder-volume[76193]: WARNING castellan.key_manager [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 17:43:37 devstack cinder-volume[76193]: WARNING cinder.keymgr.conf_key_mgr [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 17:43:37 devstack cinder-volume[76193]: DEBUG cinder.volume.drivers.lvm [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76193) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Jul 14 17:43:37 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_concurrency.processutils [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] CMD "cinder-rtstool verify" returned: 0 in 0.408s {{(pid=76193) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_db.sqlalchemy.engines [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76193) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:43:38 devstack cinder-volume[76193]: INFO cinder.rpc [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 14 17:43:38 devstack cinder-volume[76193]: INFO cinder.rpc [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 14 17:43:38 devstack cinder-volume[76193]: WARNING stevedore.named [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 14 17:43:38 devstack cinder-volume[76193]: WARNING castellan.key_manager [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 17:43:38 devstack cinder-volume[76193]: INFO cinder.volume.manager [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_db.sqlalchemy.engines [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76193) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:43:38 devstack cinder-volume[76193]: INFO oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Starting 1 workers
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Started child 76328 {{(pid=76193) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Full set of CONF: {{(pid=76193) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] ******************************************************************************** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Configuration options gathered from: {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] ================================================================================ {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] allow_availability_zone_fallback = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] allow_compression_on_image_upload = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] allowed_direct_url_schemes     = [] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] api_rate_limit                 = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] auth_strategy                  = keystone {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] az_cache_duration              = 3600 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_availability_zone      = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_host                   = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_name                   = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_stats_polling_interval = 60 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backup_api_class               = cinder.backup.api.API {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backup_name_template           = backup-%s {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backup_use_same_host           = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backup_use_temp_snapshot       = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] chap_password                  = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] chap_username                  =  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76328]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cinder_internal_tenant_project_id = e04efc6d11674c8791b321c91bb4ac40 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cinder_internal_tenant_user_id = d3231f8a504a4a75968c18e8ce350fe0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cloned_volume_same_az          = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cluster                        = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] compression_format             = gzip {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] compute_api_class              = cinder.compute.nova.API {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] config_dir                     = [] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] config_source                  = [] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] control_exchange               = openstack {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] debug                          = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] default_availability_zone      = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] default_group_type             = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] default_volume_type            = lvmdriver-1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] disk_geometry                  = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] driver_client_cert             = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] driver_client_cert_key         = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] driver_data_namespace          = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] driver_ssl_cert_path           = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] driver_ssl_cert_verify         = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] driver_use_ssl                 = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] enable_force_upload            = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] enable_new_services            = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] enable_unsupported_driver      = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] enforce_multipath_for_image_xfer = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] filter_function                = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance_api_insecure            = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance_api_servers             = ['http://192.168.122.151/image'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance_api_ssl_compression     = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance_ca_certificates_file    = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance_catalog_info            = image:glance:publicURL {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance_certfile                = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance_keyfile                 = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance_num_retries             = 3 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance_request_timeout         = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] goodness_function              = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] graceful_shutdown_timeout      = 5 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] group_api_class                = cinder.group.api.API {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] host                           = devstack {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] image_compress_on_upload       = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] image_conversion_address_space_limit = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] image_conversion_cpu_limit     = 60 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] image_conversion_disable       = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] image_upload_use_cinder_backend = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] image_upload_use_internal_tenant = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] image_volume_cache_enabled     = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] image_volume_cache_max_count   = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] image_volume_cache_max_size_gb = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] init_host_max_objects_retrieval = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] instance_format                = [instance: %(uuid)s]  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] iscsi_target_flags             =  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] iscsi_write_cache              = on {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] iser_helper                    = tgtadm {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] iser_ip_address                = 192.168.122.151 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] iser_port                      = 3260 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] log_color                      = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] log_config_append              = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] log_dir                        = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] log_file                       = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] log_options                    = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] log_rotate_interval            = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] log_rotate_interval_type       = days {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] log_rotation_type              = none {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] max_age                        = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] max_logfile_count              = 30 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] max_logfile_size_mb            = 200 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] max_over_subscription_ratio    = 20.0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] message_reap_interval          = 86400 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] message_ttl                    = 2592000 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] migration_create_volume_timeout_secs = 300 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] monkey_patch                   = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] monkey_patch_modules           = [] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] my_ip                          = 192.168.122.151 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] no_snapshot_gb_quota           = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] num_iser_scan_tries            = 3 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] num_shell_tries                = 3 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] num_volume_device_scan_tries   = 3 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] nvmeof_conn_info_version       = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] nvmet_ns_id                    = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] nvmet_port_id                  = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] osapi_max_limit                = 1000 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] osapi_volume_ext_list          = [] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] osapi_volume_listen_port       = 8776 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] osapi_volume_use_ssl           = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] osapi_volume_workers           = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] per_volume_size_limit          = -1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] periodic_fuzzy_delay           = 60 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] periodic_interval              = 60 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] public_endpoint                = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] publish_errors                 = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] quota_backup_gigabytes         = 1000 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] quota_backups                  = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] quota_gigabytes                = 1000 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] quota_groups                   = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] quota_snapshots                = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] quota_volumes                  = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] rate_limit_burst               = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] rate_limit_except_level        = CRITICAL {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76328]: INFO cinder.volume.manager [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] rate_limit_interval            = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] reinit_driver_count            = 3 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] replication_device             = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] report_discard_supported       = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] report_interval                = 120 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] reservation_clean_interval     = 86400 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] reservation_expire             = 86400 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] reserved_image_namespaces      = [] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] reserved_percentage            = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] rpc_response_timeout           = 120 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] run_external_periodic_tasks    = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] scst_target_driver             = iscsi {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] scst_target_iqn_name           = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] service_down_time              = 720 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] shell_completion               = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] snapshot_name_template         = snapshot-%s {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] snapshot_same_host             = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] split_loggers                  = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] state_path                     = /opt/stack/data/cinder {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] storage_availability_zone      = nova {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] storage_protocol               = iSCSI {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] syslog_log_facility            = LOG_USER {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] target_helper                  = lioadm {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] target_ip_address              = 192.168.122.151 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] target_port                    = 3260 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] target_protocol                = iscsi {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] target_secondary_ip_addresses  = [] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] trace_flags                    = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] transport_url                  = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] until_refresh                  = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] use_chap_auth                  = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] use_default_quota_class        = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] use_journal                    = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] use_json                       = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] use_multipath_for_image_xfer   = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] use_stderr                     = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] use_syslog                     = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] verify_glance_signatures       = enabled {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volume_api_class               = cinder.volume.api.API {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volume_backend_name            = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volume_clear                   = zero {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volume_clear_ionice            = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volume_clear_size              = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volume_copy_bps_limit          = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volume_dd_blocksize            = 1M {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volume_name_template           = volume-%s {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volume_service_inithost_offload = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volume_usage_audit_period      = month {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] zoning_mode                    = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_concurrency.disable_process_locking = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.auth_section = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.auth_type   = password {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.auth_version = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.cache       = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.certfile    = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.delay_auth_decision = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.http_connect_timeout = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.include_service_catalog = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.insecure    = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.interface   = public {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.keyfile     = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_password =  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcache_username =  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.region_name = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.service_token_roles_required = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.service_type = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.token_cache_time = 300 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.151/identity {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.backend                  = dogpile.cache.null {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.backend_argument         = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.backend_expiration_time  = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.config_prefix            = cache.oslo {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.debug_cache_backend      = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.enable_retry_client      = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.enable_socket_keepalive  = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.enabled                  = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.expiration_time          = 600 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.hashclient_retry_attempts = 2 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.memcache_dead_retry      = 300 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.memcache_pool_maxsize    = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.memcache_sasl_enabled    = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.password                 = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.proxies                  = [] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.redis_db                 = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.redis_sentinel_service_name = mymaster {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.redis_server             = localhost:6379 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.retry_attempts           = 2 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.retry_delay              = 0.0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.socket_keepalive_count   = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.socket_keepalive_idle    = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.socket_keepalive_interval = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.socket_timeout           = 1.0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.tls_allowed_ciphers      = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.tls_cafile               = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.tls_certfile             = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.tls_enabled              = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.tls_keyfile              = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cache.username                 = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] coordination.backend_url       = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.asyncio_connection    = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.asyncio_slave_connection = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.backend               = sqlalchemy {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.connection            = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.connection_debug      = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.connection_parameters =  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.connection_recycle_time = 3600 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.connection_trace      = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.db_inc_retry_interval = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.db_max_retries        = 20 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.db_max_retry_interval = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.db_retry_interval     = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.max_overflow          = 50 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.max_pool_size         = 5 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.max_retries           = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.mysql_wsrep_sync_wait = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.pool_timeout          = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.retry_interval        = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.slave_connection      = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.sqlite_synchronous    = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.synchronous_reader    = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] database.use_db_reconnect      = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler.connection_string     = messaging:// {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler.enabled               = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler.es_doc_type           = notification {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler.es_scroll_size        = 10000 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler.es_scroll_time        = 2m {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler.filter_error_trace    = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler.hmac_keys             = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler.sentinel_service_name = mymaster {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler.socket_timeout        = 0.1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler.trace_requests        = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler.trace_sqlalchemy      = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler_jaeger.process_tags   = {} {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler_jaeger.service_name_prefix = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] profiler_otlp.service_name_prefix = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_policy.enforce_new_defaults = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_policy.enforce_scope      = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_policy.policy_default_rule = default {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_policy.policy_file        = policy.yaml {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] privsep_osbrick.group          = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] privsep_osbrick.helper_command = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] privsep_osbrick.user           = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cinder_sys_admin.group         = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cinder_sys_admin.helper_command = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] cinder_sys_admin.user          = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] service_user.auth_section      = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] service_user.auth_type         = password {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] service_user.cafile            = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] service_user.certfile          = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] service_user.collect_timing    = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] service_user.insecure          = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] service_user.keyfile           = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] service_user.send_service_user_token = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] service_user.split_loggers     = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] service_user.timeout           = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance.auth_section            = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance.auth_type               = password {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance.certfile                = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance.collect_timing          = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance.insecure                = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance.keyfile                 = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance.region_name             = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance.split_loggers           = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] glance.timeout                 = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.backend_availability_zone = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.chap_password = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.chap_username =  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.disk_geometry = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.driver_client_cert = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.driver_client_cert_key = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.driver_data_namespace = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.driver_use_ssl = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.enable_unsupported_driver = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.extra_capabilities = {} {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.filter_function = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.goodness_function = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.iscsi_target_flags =  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.iscsi_write_cache = on {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.iser_helper   = tgtadm {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.iser_ip_address = 192.168.122.151 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.iser_port     = 3260 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.lvm_share_target = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.lvm_type      = auto {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.num_shell_tries = 3 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.nvmet_port_id = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.replication_device = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.report_discard_supported = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.reserved_percentage = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.scst_target_driver = iscsi {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.scst_target_iqn_name = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.storage_protocol = iSCSI {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.target_helper = tgtadm {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.target_ip_address = 192.168.122.151 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.target_port   = 3260 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.target_protocol = iscsi {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.trace_flags   = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.unique_fqdn_network = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.use_chap_auth = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.volume_backend_name = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.volume_clear  = zero {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.volume_clear_ionice = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.volume_clear_size = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_reports.file_event_handler = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_reports.log_dir           = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.backend_availability_zone = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.backend_host       = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.chap_password      = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.chap_username      = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.disk_geometry      = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.driver_client_cert = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.driver_data_namespace = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.extra_capabilities = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.filter_function    = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.goodness_function  = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.iser_helper        = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.iser_ip_address    = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.iser_port          = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.iser_target_prefix = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.lvm_share_target   = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.lvm_type           = auto {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.num_shell_tries    = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.replication_device = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.report_discard_supported = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.reserved_percentage = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.scst_target_driver = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.storage_protocol   = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.target_helper      = lioadm {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.target_ip_address  = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.target_port        = 3260 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.trace_flags        = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.use_chap_auth      = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.volume_clear       = zero {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.volume_clear_size  = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] lvmdriver-1.volumes_dir        = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack sudo[76333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack sudo[76333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.ssl      = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_notifications.driver = [] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_notifications.retry = -1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] oslo_messaging_notifications.transport_url = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] key_manager.fixed_key          = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.barbican_api_version  = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.barbican_endpoint     = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.barbican_endpoint_type = public {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.barbican_region_name  = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.cafile                = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.certfile              = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.collect_timing        = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.insecure              = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.keyfile               = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.number_of_retries     = 60 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.retry_delay           = 1 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.send_service_user_token = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.split_loggers         = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.timeout               = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.verify_ssl            = True {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican.verify_ssl_path       = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican_service_user.auth_section = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican_service_user.auth_type = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican_service_user.cafile   = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican_service_user.certfile = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican_service_user.collect_timing = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican_service_user.insecure = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican_service_user.keyfile  = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican_service_user.split_loggers = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] barbican_service_user.timeout  = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.approle_role_id          = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.approle_secret_id        = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.auth_method              = approle {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.auth_path                = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.kv_mountpoint            = secret {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.kv_path                  = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.kv_version               = 2 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.namespace                = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.root_token_id            = **** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.ssl_ca_crt_file          = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.timeout                  = 60.0 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.token_file               = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.token_role               = None {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.use_ssl                  = False {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:43:38 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] ******************************************************************************** {{(pid=76193) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 14 17:43:38 devstack sudo[76333]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:38 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:38 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:38 devstack sudo[76336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 17:43:38 devstack sudo[76336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:39 devstack sudo[76336]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:39 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.252s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:39 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:43:39 devstack cinder-volume[76328]: INFO cinder.brick.local_dev.lvm [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 14 17:43:39 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:39 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:39 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:39 devstack sudo[76391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 17:43:39 devstack sudo[76391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:39 devstack sudo[76391]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:39 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:39 devstack cinder-volume[76328]: DEBUG cinder.brick.local_dev.lvm [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76328) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Jul 14 17:43:39 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:39 devstack sudo[76504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 17:43:39 devstack sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:39 devstack sudo[76504]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:39 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.514s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:39 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:39 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:39 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:39 devstack sudo[76686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 17:43:39 devstack sudo[76686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:40 devstack sudo[76686]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:40 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:40 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:40 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:40 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:40 devstack sudo[76788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 14 17:43:40 devstack sudo[76788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:40 devstack sudo[76788]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:40 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.251s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:40 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:40 devstack sudo[76866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 17:43:40 devstack sudo[76866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:40 devstack sudo[76866]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:40 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:40 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:40 devstack sudo[76945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 17:43:40 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:40 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:40 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:40 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:41 devstack sudo[76949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:43:41 devstack sudo[76949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:41 devstack sudo[76949]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:41 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:41 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:41 devstack sudo[77031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 17:43:41 devstack sudo[77031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:41 devstack sudo[77031]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:41 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:41 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:41 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:41 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:41 devstack sudo[77038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 17:43:41 devstack sudo[77038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:41 devstack sudo[77038]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:41 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.312s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:41 devstack cinder-volume[76328]: INFO cinder.volume.drivers.lvm [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 14 17:43:41 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:41 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:41 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:41 devstack sudo[77125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 17:43:41 devstack sudo[77125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:42 devstack sudo[77125]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:42 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:42 devstack cinder-volume[76328]: DEBUG cinder.volume.drivers.lvm [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Updating volume stats {{(pid=76328) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 14 17:43:42 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:42 devstack sudo[77129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 17:43:42 devstack sudo[77129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:42 devstack sudo[77129]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:42 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:42 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:42 devstack sudo[77132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:43:42 devstack sudo[77132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:42 devstack sudo[77132]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:42 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:42 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:42 devstack sudo[77135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 17:43:42 devstack sudo[77135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:43 devstack sudo[77135]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:43 devstack sudo[77138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:43:43 devstack sudo[77138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:43 devstack sudo[77138]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:43 devstack cinder-volume[76328]: INFO cinder.volume.driver [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Driver hasn't implemented _init_vendor_properties()
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG cinder.volume.driver [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76328) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG oslo_db.sqlalchemy.engines [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76328) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG dbcounter [-] [76328] Writer thread running {{(pid=76328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG cinder.db.api [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Building query based on filter {{(pid=76328) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG cinder.image.image_utils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76328) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 14 17:43:43 devstack cinder-volume[76328]: INFO cinder.keymgr.migration [None req-996c05e0-4fb8-47e9-8adb-4f794aecae1f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG cinder.volume.drivers.lvm [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Updating volume stats {{(pid=76328) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:43 devstack sudo[77142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 17:43:43 devstack sudo[77142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:43 devstack sudo[77142]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:43 devstack sudo[77145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:43:43 devstack sudo[77145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:43 devstack sudo[77145]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:43 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:44 devstack sudo[77154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 17:43:44 devstack sudo[77154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:44 devstack sudo[77154]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:44 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:44 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:44 devstack sudo[77159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:43:44 devstack sudo[77159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:44 devstack sudo[77159]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:44 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:44 devstack cinder-volume[76328]: DEBUG cinder.manager [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Notifying Schedulers of capabilities ... {{(pid=76328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:43:44 devstack cinder-volume[76328]: INFO cinder.volume.manager [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Driver initialization completed successfully.
Jul 14 17:43:44 devstack cinder-volume[76328]: INFO cinder.manager [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Initiating service 2 cleanup
Jul 14 17:43:44 devstack cinder-volume[76328]: INFO cinder.manager [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Service 2 cleanup completed.
Jul 14 17:43:44 devstack cinder-volume[76328]: DEBUG cinder.service [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Creating RPC server for service cinder-volume {{(pid=76328) start /opt/stack/cinder/cinder/service.py:231}}
Jul 14 17:43:44 devstack cinder-volume[76328]: DEBUG cinder.service [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76328) start /opt/stack/cinder/cinder/service.py:237}}
Jul 14 17:43:44 devstack cinder-volume[76328]: INFO cinder.volume.manager [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 14 17:43:44 devstack cinder-volume[76328]: DEBUG cinder.volume.drivers.lvm [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Updating volume stats {{(pid=76328) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 14 17:43:44 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:44 devstack sudo[77162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 17:43:44 devstack sudo[77162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:44 devstack sudo[77162]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:44 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:44 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:44 devstack sudo[77167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:43:44 devstack sudo[77167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:45 devstack sudo[77167]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:45 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:45 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:45 devstack sudo[77170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 17:43:45 devstack sudo[77170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:45 devstack sudo[77170]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:45 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:45 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:43:45 devstack sudo[77173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:43:45 devstack sudo[77173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:43:45 devstack sudo[77173]: pam_unix(sudo:session): session closed for user root
Jul 14 17:43:45 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:43:45 devstack cinder-volume[76328]: INFO cinder.volume.manager [None req-7b5a74d2-6753-4133-8069-d2ea7bb59020 None None] Driver post RPC initialization completed successfully.
Jul 14 17:43:48 devstack cinder-volume[76193]: DEBUG dbcounter [-] [76193] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76193) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:43:55 devstack cinder-volume[76328]: DEBUG dbcounter [-] [76328] Writing DB stats cinder:SELECT=2 {{(pid=76328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:43:55 devstack cinder-volume[76328]: DEBUG dbcounter [-] [76328] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:44:24 devstack cinder-volume[76328]: DEBUG oslo_service.periodic_task [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running periodic task VolumeManager._thread_info {{(pid=76328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:44:24 devstack cinder-volume[76328]: DEBUG cinder.volume.manager [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] thread count: 6 {{(pid=76328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:44:24 devstack cinder-volume[76328]: DEBUG cinder.volume.manager [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] thread info: [<_MainThread(MainThread, started 123975202832512)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123975091335168)>, <Thread(Thread-3 (stat_writer), started daemon 123975091124352)>, <Thread(Rabbit-heartbeat, started daemon 123975100851840)>, <Thread(Thread-5 (_runner), started daemon 123975088804416)>, <Thread(Thread-7 (_runner), started daemon 123975088884608)>] {{(pid=76328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:45:24 devstack cinder-volume[76328]: DEBUG oslo_service.periodic_task [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:45:24 devstack cinder-volume[76328]: DEBUG cinder.volume.drivers.lvm [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Updating volume stats {{(pid=76328) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 14 17:45:24 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:45:24 devstack sudo[79833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 17:45:24 devstack sudo[79833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:45:25 devstack sudo[79833]: pam_unix(sudo:session): session closed for user root
Jul 14 17:45:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:45:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:45:25 devstack sudo[79836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:45:25 devstack sudo[79836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:45:25 devstack sudo[79836]: pam_unix(sudo:session): session closed for user root
Jul 14 17:45:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:45:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:45:25 devstack sudo[79839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 17:45:25 devstack sudo[79839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:45:25 devstack sudo[79839]: pam_unix(sudo:session): session closed for user root
Jul 14 17:45:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:45:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:45:25 devstack sudo[79905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:45:25 devstack sudo[79905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:45:25 devstack sudo[79905]: pam_unix(sudo:session): session closed for user root
Jul 14 17:45:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:45:25 devstack cinder-volume[76328]: DEBUG cinder.manager [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Notifying Schedulers of capabilities ... {{(pid=76328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:45:25 devstack cinder-volume[76328]: DEBUG oslo_service.periodic_task [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running periodic task VolumeManager._thread_info {{(pid=76328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:45:25 devstack cinder-volume[76328]: DEBUG cinder.volume.manager [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] thread count: 6 {{(pid=76328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:45:25 devstack cinder-volume[76328]: DEBUG cinder.volume.manager [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] thread info: [<_MainThread(MainThread, started 123975202832512)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123975091335168)>, <Thread(Thread-3 (stat_writer), started daemon 123975091124352)>, <Thread(Rabbit-heartbeat, started daemon 123975100851840)>, <Thread(Thread-5 (_runner), started daemon 123975088804416)>, <Thread(Thread-7 (_runner), started daemon 123975088884608)>] {{(pid=76328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:45:55 devstack cinder-volume[76328]: DEBUG dbcounter [-] [76328] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:46:24 devstack cinder-volume[76328]: DEBUG oslo_service.periodic_task [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:46:24 devstack cinder-volume[76328]: DEBUG cinder.volume.drivers.lvm [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Updating volume stats {{(pid=76328) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 14 17:46:24 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:46:24 devstack sudo[83546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 17:46:24 devstack sudo[83546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:46:25 devstack sudo[83546]: pam_unix(sudo:session): session closed for user root
Jul 14 17:46:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:46:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:46:25 devstack sudo[83564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:46:25 devstack sudo[83564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:46:25 devstack sudo[83564]: pam_unix(sudo:session): session closed for user root
Jul 14 17:46:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:46:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:46:25 devstack sudo[83580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 17:46:25 devstack sudo[83580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:46:25 devstack sudo[83580]: pam_unix(sudo:session): session closed for user root
Jul 14 17:46:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:46:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:46:25 devstack sudo[83588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:46:25 devstack sudo[83588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:46:25 devstack sudo[83588]: pam_unix(sudo:session): session closed for user root
Jul 14 17:46:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:46:25 devstack cinder-volume[76328]: DEBUG cinder.manager [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Notifying Schedulers of capabilities ... {{(pid=76328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:46:25 devstack cinder-volume[76328]: DEBUG oslo_service.periodic_task [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running periodic task VolumeManager._thread_info {{(pid=76328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:46:25 devstack cinder-volume[76328]: DEBUG cinder.volume.manager [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] thread count: 6 {{(pid=76328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:46:25 devstack cinder-volume[76328]: DEBUG cinder.volume.manager [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] thread info: [<_MainThread(MainThread, started 123975202832512)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123975091335168)>, <Thread(Thread-3 (stat_writer), started daemon 123975091124352)>, <Thread(Rabbit-heartbeat, started daemon 123975100851840)>, <Thread(Thread-5 (_runner), started daemon 123975088804416)>, <Thread(Thread-7 (_runner), started daemon 123975088884608)>] {{(pid=76328) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:47:24 devstack cinder-volume[76328]: DEBUG oslo_service.periodic_task [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76328) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:47:24 devstack cinder-volume[76328]: DEBUG cinder.volume.drivers.lvm [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Updating volume stats {{(pid=76328) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 14 17:47:24 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:47:24 devstack sudo[85197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 17:47:24 devstack sudo[85197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:47:25 devstack sudo[85197]: pam_unix(sudo:session): session closed for user root
Jul 14 17:47:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:47:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:47:25 devstack sudo[85200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:47:25 devstack sudo[85200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:47:25 devstack sudo[85200]: pam_unix(sudo:session): session closed for user root
Jul 14 17:47:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:47:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:47:25 devstack sudo[85203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 17:47:25 devstack sudo[85203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:47:25 devstack sudo[85203]: pam_unix(sudo:session): session closed for user root
Jul 14 17:47:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:47:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:47:25 devstack sudo[85208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 17:47:25 devstack sudo[85208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:47:25 devstack sudo[85208]: pam_unix(sudo:session): session closed for user root
Jul 14 17:47:25 devstack cinder-volume[76328]: DEBUG oslo_concurrency.processutils [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76328) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:47:25 devstack cinder-volume[76328]: DEBUG cinder.manager [None req-976a8db2-eb07-4d15-ab7e-394bd35c07dc None None] Notifying Schedulers of capabilities ... {{(pid=76328) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:47:55 devstack cinder-volume[76328]: DEBUG dbcounter [-] [76328] Writing DB stats cinder:SELECT=1 {{(pid=76328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:47:55 devstack cinder-volume[76328]: DEBUG dbcounter [-] [76328] Writing DB stats cinder:UPDATE=1 {{(pid=76328) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:48:19 devstack cinder-volume[76193]: INFO oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Caught SIGTERM, stopping children
Jul 14 17:48:19 devstack cinder-volume[76193]: DEBUG oslo_concurrency.lockutils [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Acquiring lock "singleton_lock" {{(pid=76193) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 17:48:19 devstack cinder-volume[76193]: DEBUG oslo_concurrency.lockutils [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Acquired lock "singleton_lock" {{(pid=76193) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 17:48:19 devstack cinder-volume[76193]: DEBUG oslo_concurrency.lockutils [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Releasing lock "singleton_lock" {{(pid=76193) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 17:48:19 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Stop services. {{(pid=76193) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 14 17:48:19 devstack cinder-volume[76193]: DEBUG oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Killing children. {{(pid=76193) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 14 17:48:19 devstack cinder-volume[76193]: INFO oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Waiting on 1 children to exit
Jul 14 17:48:19 devstack cinder-volume[76328]: DEBUG oslo_concurrency.lockutils [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Acquiring lock "singleton_lock" {{(pid=76328) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 17:48:19 devstack cinder-volume[76328]: DEBUG oslo_concurrency.lockutils [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Acquired lock "singleton_lock" {{(pid=76328) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 17:48:19 devstack cinder-volume[76328]: DEBUG oslo_concurrency.lockutils [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Releasing lock "singleton_lock" {{(pid=76328) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 17:48:19 devstack cinder-volume[76328]: WARNING amqp [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 14 17:48:19 devstack cinder-volume[76328]: WARNING amqp [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 14 17:48:19 devstack cinder-volume[76193]: INFO oslo_service.backend._eventlet.service [None req-0f72b56a-9ea5-4027-9564-ade7bb5dcf6c None None] Child 76328 exited with status 0
Jul 14 17:48:20 devstack cinder-volume[86401]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 14 17:48:20 devstack cinder-volume[86401]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 14 17:48:20 devstack cinder-volume[86401]: we strongly recommend against using it for new projects.
Jul 14 17:48:20 devstack cinder-volume[86401]: If you are already using Eventlet, we recommend migrating to a different
Jul 14 17:48:20 devstack cinder-volume[86401]: framework.  For more detail see
Jul 14 17:48:20 devstack cinder-volume[86401]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 14 17:48:20 devstack cinder-volume[86401]:   import eventlet  # noqa
Jul 14 17:48:22 devstack cinder-volume[86401]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 17:48:22 devstack cinder-volume[86401]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 17:48:22 devstack cinder-volume[86401]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 17:48:22 devstack cinder-volume[86401]: INFO dbcounter [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Registered counter for database cinder
Jul 14 17:48:22 devstack cinder-volume[86401]: DEBUG oslo_db.sqlalchemy.engines [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG dbcounter [-] [86401] Writer thread running {{(pid=86401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 14 17:48:23 devstack cinder-volume[86401]: INFO cinder.rpc [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 14 17:48:23 devstack cinder-volume[86401]: INFO cinder.rpc [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_db.sqlalchemy.engines [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:48:23 devstack cinder-volume[86401]: INFO cinder.volume.manager [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Determined volume DB was empty at startup.
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG cinder.volume.manager [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86401) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 14 17:48:23 devstack cinder-volume[86401]: INFO cinder.volume.manager [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 14 17:48:23 devstack cinder-volume[86401]: WARNING stevedore.named [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 14 17:48:23 devstack cinder-volume[86401]: WARNING castellan.key_manager [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 17:48:23 devstack cinder-volume[86401]: WARNING cinder.keymgr.conf_key_mgr [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 17:48:23 devstack cinder-volume[86401]: INFO cinder.volume.manager [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_db.sqlalchemy.engines [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:48:23 devstack cinder-volume[86401]: INFO oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Starting 1 workers
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Started child 86616 {{(pid=86401) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Full set of CONF: {{(pid=86401) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] ******************************************************************************** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Configuration options gathered from: {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] ================================================================================ {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] allow_availability_zone_fallback = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] allow_compression_on_image_upload = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] allowed_direct_url_schemes     = [] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] api_rate_limit                 = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] auth_strategy                  = keystone {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_availability_zone      = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86616]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_host                   = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_name                   = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_stats_polling_interval = 60 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backup_api_class               = cinder.backup.api.API {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backup_name_template           = backup-%s {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backup_use_same_host           = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backup_use_temp_snapshot       = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] chap_password                  = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] chap_username                  =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cinder_internal_tenant_project_id = e04efc6d11674c8791b321c91bb4ac40 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cinder_internal_tenant_user_id = d3231f8a504a4a75968c18e8ce350fe0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cluster                        = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] compression_format             = gzip {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] compute_api_class              = cinder.compute.nova.API {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] config_dir                     = [] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] config_source                  = [] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] control_exchange               = openstack {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] debug                          = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] default_availability_zone      = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] default_group_type             = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] default_volume_type            = QuobyteHD {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] disk_geometry                  = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] driver_client_cert             = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] driver_client_cert_key         = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] driver_data_namespace          = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] driver_ssl_cert_path           = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] driver_ssl_cert_verify         = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] driver_use_ssl                 = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] enable_new_services            = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] enable_unsupported_driver      = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] enabled_backends               = ['QuobyteHD'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] enforce_multipath_for_image_xfer = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] filter_function                = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance_api_insecure            = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance_api_servers             = ['http://192.168.122.151/image'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance_api_ssl_compression     = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance_ca_certificates_file    = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance_catalog_info            = image:glance:publicURL {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance_certfile                = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance_keyfile                 = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance_num_retries             = 3 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance_request_timeout         = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] goodness_function              = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] graceful_shutdown_timeout      = 5 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] group_api_class                = cinder.group.api.API {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] host                           = devstack {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] image_compress_on_upload       = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] image_conversion_address_space_limit = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] image_conversion_cpu_limit     = 60 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] image_conversion_disable       = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] image_upload_use_cinder_backend = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] image_upload_use_internal_tenant = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] image_volume_cache_enabled     = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] image_volume_cache_max_count   = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] image_volume_cache_max_size_gb = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] init_host_max_objects_retrieval = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] instance_format                = [instance: %(uuid)s]  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] iscsi_target_flags             =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] iscsi_write_cache              = on {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] iser_helper                    = tgtadm {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] iser_ip_address                = 192.168.122.151 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] iser_port                      = 3260 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] log_color                      = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] log_config_append              = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] log_dir                        = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] log_file                       = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] log_options                    = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] log_rotate_interval            = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] log_rotate_interval_type       = days {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] log_rotation_type              = none {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] max_age                        = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] max_logfile_count              = 30 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] max_logfile_size_mb            = 200 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] max_over_subscription_ratio    = 20.0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] message_reap_interval          = 86400 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] message_ttl                    = 2592000 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] migration_create_volume_timeout_secs = 300 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] monkey_patch                   = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] monkey_patch_modules           = [] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] my_ip                          = 192.168.122.151 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] no_snapshot_gb_quota           = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] num_iser_scan_tries            = 3 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] num_shell_tries                = 3 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] num_volume_device_scan_tries   = 3 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] nvmeof_conn_info_version       = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] nvmet_ns_id                    = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] nvmet_port_id                  = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] osapi_max_limit                = 1000 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] osapi_volume_ext_list          = [] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] osapi_volume_listen_port       = 8776 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] osapi_volume_use_ssl           = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] osapi_volume_workers           = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] per_volume_size_limit          = -1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] periodic_fuzzy_delay           = 60 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] periodic_interval              = 60 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] public_endpoint                = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] publish_errors                 = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] quota_backup_gigabytes         = 1000 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] quota_backups                  = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] quota_gigabytes                = 1000 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] quota_groups                   = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] quota_snapshots                = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] quota_volumes                  = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] rate_limit_burst               = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86616]: INFO cinder.volume.manager [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 14 17:48:23 devstack cinder-volume[86616]: DEBUG cinder.volume.drivers.remotefs [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86616) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] rate_limit_except_level        = CRITICAL {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] rate_limit_interval            = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] reinit_driver_count            = 3 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] replication_device             = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] report_discard_supported       = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] report_interval                = 120 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] reservation_clean_interval     = 86400 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] reservation_expire             = 86400 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] reserved_image_namespaces      = [] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] reserved_percentage            = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] rpc_response_timeout           = 120 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] run_external_periodic_tasks    = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] scst_target_driver             = iscsi {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] scst_target_iqn_name           = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] service_down_time              = 720 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] shell_completion               = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] snapshot_name_template         = snapshot-%s {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] split_loggers                  = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] state_path                     = /opt/stack/data/cinder {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] storage_availability_zone      = nova {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] storage_protocol               = iSCSI {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] syslog_log_facility            = LOG_USER {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] target_helper                  = lioadm {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] target_ip_address              = 192.168.122.151 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] target_port                    = 3260 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] target_protocol                = iscsi {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] target_secondary_ip_addresses  = [] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] trace_flags                    = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] transport_url                  = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] until_refresh                  = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] use_chap_auth                  = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] use_default_quota_class        = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] use_journal                    = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] use_json                       = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] use_multipath_for_image_xfer   = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] use_stderr                     = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] use_syslog                     = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] verify_glance_signatures       = enabled {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volume_api_class               = cinder.volume.api.API {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volume_backend_name            = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volume_clear                   = zero {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volume_clear_ionice            = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volume_clear_size              = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volume_copy_bps_limit          = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volume_dd_blocksize            = 1M {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volume_name_template           = volume-%s {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volume_service_inithost_offload = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volume_usage_audit_period      = month {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] zoning_mode                    = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_concurrency.disable_process_locking = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.auth_section = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.auth_type   = password {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.auth_version = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.cache       = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.certfile    = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.delay_auth_decision = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.http_connect_timeout = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.include_service_catalog = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.insecure    = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.interface   = public {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.keyfile     = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_password =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcache_username =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.region_name = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.service_token_roles_required = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.service_type = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.token_cache_time = 300 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.151/identity {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.backend                  = dogpile.cache.null {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.backend_argument         = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.backend_expiration_time  = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.config_prefix            = cache.oslo {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.debug_cache_backend      = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.enable_retry_client      = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.enable_socket_keepalive  = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.enabled                  = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.expiration_time          = 600 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.hashclient_retry_attempts = 2 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.memcache_dead_retry      = 300 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.memcache_pool_maxsize    = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.memcache_sasl_enabled    = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.password                 = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.proxies                  = [] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.redis_db                 = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.redis_sentinel_service_name = mymaster {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.redis_server             = localhost:6379 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.retry_attempts           = 2 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.retry_delay              = 0.0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.socket_keepalive_count   = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.socket_keepalive_idle    = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.socket_keepalive_interval = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.socket_timeout           = 1.0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.tls_allowed_ciphers      = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.tls_cafile               = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.tls_certfile             = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.tls_enabled              = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.tls_keyfile              = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cache.username                 = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] coordination.backend_url       = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.asyncio_connection    = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.asyncio_slave_connection = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.backend               = sqlalchemy {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.connection            = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.connection_debug      = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.connection_parameters =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.connection_recycle_time = 3600 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.connection_trace      = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.db_inc_retry_interval = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.db_max_retries        = 20 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.db_max_retry_interval = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.db_retry_interval     = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.max_overflow          = 50 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.max_pool_size         = 5 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.max_retries           = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.mysql_wsrep_sync_wait = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.pool_timeout          = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.retry_interval        = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.slave_connection      = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.sqlite_synchronous    = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.synchronous_reader    = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] database.use_db_reconnect      = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86616]: DEBUG cinder.volume.drivers.quobyte [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86616) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 14 17:48:23 devstack cinder-volume[86616]: WARNING cinder.volume.drivers.quobyte [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86616]: WARNING cinder.volume.drivers.quobyte [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler.connection_string     = messaging:// {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler.enabled               = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler.es_doc_type           = notification {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86616]: DEBUG oslo_concurrency.processutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Running cmd (subprocess): mount.quobyte {{(pid=86616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler.es_scroll_size        = 10000 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler.es_scroll_time        = 2m {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler.filter_error_trace    = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler.hmac_keys             = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler.sentinel_service_name = mymaster {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler.socket_timeout        = 0.1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler.trace_requests        = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler.trace_sqlalchemy      = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler_jaeger.process_tags   = {} {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler_jaeger.service_name_prefix = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] profiler_otlp.service_name_prefix = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_policy.enforce_new_defaults = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_policy.enforce_scope      = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_policy.policy_default_rule = default {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_policy.policy_file        = policy.yaml {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] privsep_osbrick.group          = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] privsep_osbrick.helper_command = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] privsep_osbrick.user           = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cinder_sys_admin.group         = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cinder_sys_admin.helper_command = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] cinder_sys_admin.user          = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] service_user.auth_section      = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] service_user.auth_type         = password {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] service_user.cafile            = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] service_user.certfile          = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] service_user.collect_timing    = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] service_user.insecure          = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] service_user.keyfile           = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] service_user.send_service_user_token = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] service_user.split_loggers     = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] service_user.timeout           = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance.auth_section            = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance.auth_type               = password {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance.certfile                = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance.collect_timing          = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance.insecure                = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance.keyfile                 = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance.region_name             = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance.split_loggers           = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] glance.timeout                 = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.backend_availability_zone = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.chap_password = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.chap_username =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.disk_geometry = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.driver_client_cert = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.driver_client_cert_key = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.driver_data_namespace = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.driver_use_ssl = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.enable_unsupported_driver = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.extra_capabilities = {} {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.filter_function = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.goodness_function = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.iscsi_target_flags =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.iscsi_write_cache = on {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.iser_helper   = tgtadm {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.iser_ip_address = 192.168.122.151 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.iser_port     = 3260 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nas_host      =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nas_login     = admin {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nas_mount_options = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nas_password  = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nas_private_key =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nas_share_path =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.num_shell_tries = 3 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.nvmet_port_id = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.quobyte_client_cfg = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack quobyte-client[86621]: Reading configuration file: /etc/quobyte/client.cfg
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack quobyte-client[86621]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.quobyte_volume_url = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.replication_device = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.report_discard_supported = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.reserved_percentage = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.scst_target_driver = iscsi {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.scst_target_iqn_name = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.storage_protocol = iSCSI {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.target_helper = tgtadm {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.target_ip_address = 192.168.122.151 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.target_port   = 3260 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.target_protocol = iscsi {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.trace_flags   = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.unique_fqdn_network = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.use_chap_auth = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.volume_backend_name = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.volume_clear  = zero {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.volume_clear_ionice = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.volume_clear_size = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86616]: DEBUG oslo_concurrency.processutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=86616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_reports.file_event_handler = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_reports.log_dir           = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.backend_availability_zone = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.backend_host         = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:48:23 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.chap_password        = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86616]: DEBUG cinder.volume.drivers.quobyte [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=86616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.chap_username        = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.chiscsi_conf         = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.disk_geometry        = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86616]: INFO cinder.volume.drivers.quobyte [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b ...
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.driver_client_cert   = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86616]: DEBUG oslo_concurrency.processutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 -c /etc/quobyte/client-cinder.cfg {{(pid=86616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.driver_client_cert_key = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.driver_data_namespace = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.driver_use_ssl       = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.extra_capabilities   = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.filter_function      = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.goodness_function    = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.iser_helper          = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.iser_ip_address      = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.iser_port            = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.iser_target_prefix   = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nas_host             = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nas_login            = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nas_mount_options    = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nas_password         = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nas_private_key      = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nas_share_path       = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nas_ssh_port         = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.num_shell_tries      = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.nvmet_port_id        = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.replication_device   = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.report_discard_supported = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack sudo[86622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 -c /etc/quobyte/client-cinder.cfg
Jul 14 17:48:23 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.reserved_percentage  = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.scst_target_driver   = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.storage_protocol     = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.target_helper        = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.target_ip_address    = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.target_port          = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.target_prefix        = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.target_protocol      = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.trace_flags          = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.use_chap_auth        = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.volume_clear         = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.volume_clear_size    = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] QuobyteHD.volumes_dir          = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:23 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.ssl      = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_notifications.driver = [] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_notifications.retry = -1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] oslo_messaging_notifications.transport_url = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] key_manager.fixed_key          = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.barbican_api_version  = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.barbican_endpoint     = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.barbican_endpoint_type = public {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.barbican_region_name  = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.cafile                = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.certfile              = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.collect_timing        = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.insecure              = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.keyfile               = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.number_of_retries     = 60 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.retry_delay           = 1 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.send_service_user_token = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.split_loggers         = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.timeout               = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.verify_ssl            = True {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican.verify_ssl_path       = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican_service_user.auth_section = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican_service_user.auth_type = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican_service_user.cafile   = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican_service_user.certfile = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican_service_user.collect_timing = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican_service_user.insecure = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican_service_user.keyfile  = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican_service_user.split_loggers = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] barbican_service_user.timeout  = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.approle_role_id          = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.approle_secret_id        = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.auth_method              = approle {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.auth_path                = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.kv_mountpoint            = secret {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.kv_path                  = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.kv_version               = 2 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.namespace                = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.root_token_id            = **** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.ssl_ca_crt_file          = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.timeout                  = 60.0 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.token_file               = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.token_role               = None {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.use_ssl                  = False {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:24 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] ******************************************************************************** {{(pid=86401) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 14 17:48:24 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG oslo_concurrency.processutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.404s {{(pid=86616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:48:24 devstack cinder-volume[86616]: INFO cinder.volume.drivers.quobyte [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b succeeded
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG cinder.volume.drivers.quobyte [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=86616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.418s {{(pid=86616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG oslo_concurrency.processutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=86616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:48:24 devstack sudo[86691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:48:24 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:48:24 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG oslo_concurrency.processutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.234s {{(pid=86616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:48:24 devstack cinder-volume[86616]: INFO cinder.volume.driver [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Driver hasn't implemented _init_vendor_properties()
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG cinder.volume.driver [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86616) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG oslo_db.sqlalchemy.engines [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86616) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG dbcounter [-] [86616] Writer thread running {{(pid=86616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG cinder.db.api [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Building query based on filter {{(pid=86616) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG cinder.image.image_utils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86616) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 14 17:48:24 devstack cinder-volume[86616]: INFO cinder.keymgr.migration [None req-0b152e74-171b-40f4-b2ff-25f0901475b1 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG cinder.volume.drivers.quobyte [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=86616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG cinder.volume.drivers.quobyte [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=86616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:48:24 devstack cinder-volume[86616]: DEBUG oslo_concurrency.processutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=86616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:48:24 devstack sudo[86694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:48:24 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:48:25 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root
Jul 14 17:48:25 devstack cinder-volume[86616]: DEBUG oslo_concurrency.processutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.241s {{(pid=86616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:48:25 devstack cinder-volume[86616]: DEBUG cinder.manager [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Notifying Schedulers of capabilities ... {{(pid=86616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:48:25 devstack cinder-volume[86616]: INFO cinder.volume.manager [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Driver initialization completed successfully.
Jul 14 17:48:25 devstack cinder-volume[86616]: INFO cinder.manager [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Initiating service 3 cleanup
Jul 14 17:48:25 devstack cinder-volume[86616]: INFO cinder.manager [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Service 3 cleanup completed.
Jul 14 17:48:25 devstack cinder-volume[86616]: DEBUG cinder.service [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Creating RPC server for service cinder-volume {{(pid=86616) start /opt/stack/cinder/cinder/service.py:231}}
Jul 14 17:48:25 devstack cinder-volume[86616]: DEBUG cinder.service [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86616) start /opt/stack/cinder/cinder/service.py:237}}
Jul 14 17:48:25 devstack cinder-volume[86616]: INFO cinder.volume.manager [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 14 17:48:25 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:48:25 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:48:25 devstack cinder-volume[86616]: DEBUG cinder.volume.drivers.quobyte [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=86616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:48:25 devstack cinder-volume[86616]: DEBUG cinder.volume.drivers.quobyte [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=86616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:48:25 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:48:25 devstack cinder-volume[86616]: DEBUG oslo_concurrency.processutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=86616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:48:25 devstack sudo[86697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:48:25 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:48:25 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root
Jul 14 17:48:25 devstack cinder-volume[86616]: DEBUG oslo_concurrency.processutils [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.312s {{(pid=86616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:48:25 devstack cinder-volume[86616]: INFO cinder.volume.manager [None req-e3d39078-1bfe-458b-8734-911381c38e14 None None] Driver post RPC initialization completed successfully.
Jul 14 17:48:30 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-a80afc26-8ee1-46c3-b100-53922e4782ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:48:30 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-a80afc26-8ee1-46c3-b100-53922e4782ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:48:30 devstack cinder-volume[86616]: DEBUG cinder.volume.drivers.quobyte [None req-a80afc26-8ee1-46c3-b100-53922e4782ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=86616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:48:30 devstack cinder-volume[86616]: DEBUG cinder.volume.drivers.quobyte [None req-a80afc26-8ee1-46c3-b100-53922e4782ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=86616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:48:30 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-a80afc26-8ee1-46c3-b100-53922e4782ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:48:30 devstack cinder-volume[86616]: DEBUG oslo_concurrency.processutils [None req-a80afc26-8ee1-46c3-b100-53922e4782ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=86616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:48:30 devstack sudo[86938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:48:30 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:48:30 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root
Jul 14 17:48:30 devstack cinder-volume[86616]: DEBUG oslo_concurrency.processutils [None req-a80afc26-8ee1-46c3-b100-53922e4782ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.236s {{(pid=86616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:48:30 devstack cinder-volume[86616]: DEBUG cinder.manager [None req-a80afc26-8ee1-46c3-b100-53922e4782ac None None] Notifying Schedulers of capabilities ... {{(pid=86616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:48:33 devstack cinder-volume[86401]: INFO oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Caught SIGTERM, stopping children
Jul 14 17:48:33 devstack cinder-volume[86401]: DEBUG oslo_concurrency.lockutils [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Acquiring lock "singleton_lock" {{(pid=86401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 17:48:33 devstack cinder-volume[86401]: DEBUG oslo_concurrency.lockutils [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Acquired lock "singleton_lock" {{(pid=86401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 17:48:33 devstack cinder-volume[86401]: DEBUG oslo_concurrency.lockutils [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Releasing lock "singleton_lock" {{(pid=86401) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 17:48:33 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Stop services. {{(pid=86401) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 14 17:48:33 devstack cinder-volume[86401]: DEBUG oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Killing children. {{(pid=86401) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 14 17:48:33 devstack cinder-volume[86401]: INFO oslo_service.backend._eventlet.service [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Waiting on 1 children to exit
Jul 14 17:48:35 devstack cinder-volume[86616]: DEBUG dbcounter [-] [86616] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:48:35 devstack cinder-volume[86616]: DEBUG dbcounter [-] [86616] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:48:38 devstack cinder-volume[86616]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 14 17:48:38 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Acquiring lock "singleton_lock" {{(pid=86616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 17:48:38 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Acquired lock "singleton_lock" {{(pid=86616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 17:48:38 devstack cinder-volume[86616]: DEBUG oslo_concurrency.lockutils [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Releasing lock "singleton_lock" {{(pid=86616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 17:48:38 devstack cinder-volume[86616]: WARNING amqp [None req-502d6c33-e10a-44ff-b629-a7af8a3a42ac None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 14 17:48:38 devstack cinder-volume[87156]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 14 17:48:38 devstack cinder-volume[87156]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 14 17:48:38 devstack cinder-volume[87156]: we strongly recommend against using it for new projects.
Jul 14 17:48:38 devstack cinder-volume[87156]: If you are already using Eventlet, we recommend migrating to a different
Jul 14 17:48:38 devstack cinder-volume[87156]: framework.  For more detail see
Jul 14 17:48:38 devstack cinder-volume[87156]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 14 17:48:38 devstack cinder-volume[87156]:   import eventlet  # noqa
Jul 14 17:48:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 17:48:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 17:48:41 devstack cinder-volume[87156]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 17:48:41 devstack cinder-volume[87156]: INFO dbcounter [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] Registered counter for database cinder
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_db.sqlalchemy.engines [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writer thread running {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 14 17:48:42 devstack cinder-volume[87156]: INFO cinder.rpc [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 14 17:48:42 devstack cinder-volume[87156]: INFO cinder.rpc [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_db.sqlalchemy.engines [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:48:42 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] Determined volume DB was empty at startup.
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG cinder.volume.manager [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87156) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 14 17:48:42 devstack cinder-volume[87156]: WARNING stevedore.named [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 14 17:48:42 devstack cinder-volume[87156]: WARNING castellan.key_manager [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 17:48:42 devstack cinder-volume[87156]: WARNING cinder.keymgr.conf_key_mgr [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 17:48:42 devstack cinder-volume[87156]: INFO cinder.volume.manager [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_db.sqlalchemy.engines [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:48:42 devstack cinder-volume[87156]: INFO oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] Starting 1 workers
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] Started child 87401 {{(pid=87156) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] Full set of CONF: {{(pid=87156) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] ******************************************************************************** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] Configuration options gathered from: {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] ================================================================================ {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] allow_availability_zone_fallback = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] allow_compression_on_image_upload = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] allowed_direct_url_schemes     = [] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] api_rate_limit                 = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] auth_strategy                  = keystone {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_availability_zone      = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87401]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_host                   = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_name                   = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_stats_polling_interval = 60 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backup_api_class               = cinder.backup.api.API {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backup_name_template           = backup-%s {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backup_use_same_host           = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backup_use_temp_snapshot       = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] chap_password                  = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] chap_username                  =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cinder_internal_tenant_project_id = e04efc6d11674c8791b321c91bb4ac40 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cinder_internal_tenant_user_id = d3231f8a504a4a75968c18e8ce350fe0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cluster                        = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] compression_format             = gzip {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] compute_api_class              = cinder.compute.nova.API {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] config_dir                     = [] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] config_source                  = [] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] control_exchange               = openstack {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] debug                          = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] default_availability_zone      = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] default_group_type             = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] default_volume_type            = QuobyteHD {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] disk_geometry                  = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] driver_client_cert             = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] driver_client_cert_key         = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] driver_data_namespace          = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] driver_ssl_cert_path           = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] driver_ssl_cert_verify         = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] driver_use_ssl                 = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] enable_new_services            = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] enable_unsupported_driver      = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] enabled_backends               = ['QuobyteHD'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] enforce_multipath_for_image_xfer = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] filter_function                = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance_api_insecure            = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance_api_servers             = ['http://192.168.122.151/image'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance_api_ssl_compression     = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance_ca_certificates_file    = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance_catalog_info            = image:glance:publicURL {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance_certfile                = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance_keyfile                 = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance_num_retries             = 3 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance_request_timeout         = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] goodness_function              = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] graceful_shutdown_timeout      = 5 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] group_api_class                = cinder.group.api.API {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] host                           = devstack {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] image_compress_on_upload       = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] image_conversion_address_space_limit = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] image_conversion_cpu_limit     = 60 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] image_conversion_disable       = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] image_upload_use_cinder_backend = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] image_upload_use_internal_tenant = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] image_volume_cache_enabled     = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] image_volume_cache_max_count   = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] image_volume_cache_max_size_gb = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] init_host_max_objects_retrieval = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] instance_format                = [instance: %(uuid)s]  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] iscsi_target_flags             =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] iscsi_write_cache              = on {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] iser_helper                    = tgtadm {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] iser_ip_address                = 192.168.122.151 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] iser_port                      = 3260 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] log_color                      = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] log_config_append              = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] log_dir                        = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] log_file                       = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] log_options                    = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] log_rotate_interval            = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] log_rotate_interval_type       = days {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] log_rotation_type              = none {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] max_age                        = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] max_logfile_count              = 30 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] max_logfile_size_mb            = 200 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] max_over_subscription_ratio    = 20.0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] message_reap_interval          = 86400 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] message_ttl                    = 2592000 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] migration_create_volume_timeout_secs = 300 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] monkey_patch                   = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] monkey_patch_modules           = [] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] my_ip                          = 192.168.122.151 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] no_snapshot_gb_quota           = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] num_iser_scan_tries            = 3 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] num_shell_tries                = 3 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] num_volume_device_scan_tries   = 3 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] nvmeof_conn_info_version       = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] nvmet_ns_id                    = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] nvmet_port_id                  = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] osapi_max_limit                = 1000 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] osapi_volume_ext_list          = [] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] osapi_volume_listen_port       = 8776 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] osapi_volume_use_ssl           = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] osapi_volume_workers           = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] per_volume_size_limit          = -1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] periodic_fuzzy_delay           = 60 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] periodic_interval              = 60 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] public_endpoint                = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] publish_errors                 = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] quota_backup_gigabytes         = 1000 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] quota_backups                  = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87401) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] quota_gigabytes                = 1000 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] quota_groups                   = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] quota_snapshots                = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] quota_volumes                  = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] rate_limit_burst               = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] rate_limit_except_level        = CRITICAL {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] rate_limit_interval            = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] reinit_driver_count            = 3 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] replication_device             = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] report_discard_supported       = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] report_interval                = 120 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] reservation_clean_interval     = 86400 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] reservation_expire             = 86400 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] reserved_image_namespaces      = [] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] reserved_percentage            = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] rpc_response_timeout           = 120 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] run_external_periodic_tasks    = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] scst_target_driver             = iscsi {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] scst_target_iqn_name           = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] service_down_time              = 720 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] shell_completion               = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] snapshot_name_template         = snapshot-%s {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] split_loggers                  = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] state_path                     = /opt/stack/data/cinder {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] storage_availability_zone      = nova {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] storage_protocol               = iSCSI {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] syslog_log_facility            = LOG_USER {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] target_helper                  = lioadm {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] target_ip_address              = 192.168.122.151 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] target_port                    = 3260 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] target_protocol                = iscsi {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] target_secondary_ip_addresses  = [] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] trace_flags                    = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] transport_url                  = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] until_refresh                  = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] use_chap_auth                  = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] use_default_quota_class        = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] use_journal                    = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] use_json                       = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] use_multipath_for_image_xfer   = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] use_stderr                     = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] use_syslog                     = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] verify_glance_signatures       = enabled {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volume_api_class               = cinder.volume.api.API {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volume_backend_name            = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volume_clear                   = zero {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volume_clear_ionice            = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volume_clear_size              = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volume_copy_bps_limit          = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volume_dd_blocksize            = 1M {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volume_name_template           = volume-%s {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volume_service_inithost_offload = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volume_usage_audit_period      = month {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] zoning_mode                    = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_concurrency.disable_process_locking = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.auth_section = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.auth_type   = password {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.auth_version = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.cache       = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.certfile    = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.delay_auth_decision = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.http_connect_timeout = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.include_service_catalog = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.insecure    = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.interface   = public {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.keyfile     = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_password =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcache_username =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.region_name = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.service_token_roles_required = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.service_type = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.token_cache_time = 300 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.151/identity {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.backend                  = dogpile.cache.null {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.backend_argument         = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.backend_expiration_time  = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.config_prefix            = cache.oslo {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.debug_cache_backend      = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.enable_retry_client      = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.enable_socket_keepalive  = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.enabled                  = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.expiration_time          = 600 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.hashclient_retry_attempts = 2 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.memcache_dead_retry      = 300 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.memcache_pool_maxsize    = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.memcache_sasl_enabled    = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.password                 = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.proxies                  = [] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.redis_db                 = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.redis_sentinel_service_name = mymaster {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.redis_server             = localhost:6379 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.retry_attempts           = 2 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.retry_delay              = 0.0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.socket_keepalive_count   = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.socket_keepalive_idle    = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.socket_keepalive_interval = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.socket_timeout           = 1.0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.tls_allowed_ciphers      = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.tls_cafile               = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.tls_certfile             = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.tls_enabled              = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.tls_keyfile              = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cache.username                 = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] coordination.backend_url       = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.asyncio_connection    = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.asyncio_slave_connection = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.backend               = sqlalchemy {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.connection            = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.connection_debug      = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.connection_parameters =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.connection_recycle_time = 3600 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.connection_trace      = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.db_inc_retry_interval = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.db_max_retries        = 20 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.db_max_retry_interval = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.db_retry_interval     = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.max_overflow          = 50 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.max_pool_size         = 5 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.max_retries           = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.mysql_wsrep_sync_wait = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.pool_timeout          = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.retry_interval        = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.slave_connection      = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.sqlite_synchronous    = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.synchronous_reader    = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] database.use_db_reconnect      = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler.connection_string     = messaging:// {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler.enabled               = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler.es_doc_type           = notification {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler.es_scroll_size        = 10000 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler.es_scroll_time        = 2m {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler.filter_error_trace    = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler.hmac_keys             = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler.sentinel_service_name = mymaster {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler.socket_timeout        = 0.1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler.trace_requests        = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler.trace_sqlalchemy      = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler_jaeger.process_tags   = {} {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler_jaeger.service_name_prefix = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] profiler_otlp.service_name_prefix = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_policy.enforce_new_defaults = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_policy.enforce_scope      = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_policy.policy_default_rule = default {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_policy.policy_file        = policy.yaml {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] privsep_osbrick.group          = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87401) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 14 17:48:42 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.quobyte [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] privsep_osbrick.helper_command = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] privsep_osbrick.user           = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cinder_sys_admin.group         = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.quobyte [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cinder_sys_admin.helper_command = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] cinder_sys_admin.user          = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] service_user.auth_section      = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] service_user.auth_type         = password {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Running cmd (subprocess): mount.quobyte {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] service_user.cafile            = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] service_user.certfile          = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] service_user.collect_timing    = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] service_user.insecure          = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] service_user.keyfile           = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] service_user.send_service_user_token = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] service_user.split_loggers     = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] service_user.timeout           = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance.auth_section            = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance.auth_type               = password {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance.certfile                = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance.collect_timing          = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance.insecure                = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance.keyfile                 = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance.region_name             = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance.split_loggers           = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] glance.timeout                 = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.backend_availability_zone = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.chap_password = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.chap_username =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.disk_geometry = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.driver_client_cert = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.driver_client_cert_key = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.driver_data_namespace = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.driver_use_ssl = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.enable_unsupported_driver = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.extra_capabilities = {} {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.filter_function = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.goodness_function = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.iscsi_target_flags =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.iscsi_write_cache = on {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.iser_helper   = tgtadm {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.iser_ip_address = 192.168.122.151 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.iser_port     = 3260 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nas_host      =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nas_login     = admin {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nas_mount_options = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nas_password  = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nas_private_key =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nas_share_path =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.num_shell_tries = 3 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.nvmet_port_id = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.quobyte_client_cfg = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.quobyte_volume_url = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.replication_device = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.report_discard_supported = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.reserved_percentage = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.scst_target_driver = iscsi {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.scst_target_iqn_name = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.storage_protocol = iSCSI {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.target_helper = tgtadm {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.target_ip_address = 192.168.122.151 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.target_port   = 3260 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.target_protocol = iscsi {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.trace_flags   = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.unique_fqdn_network = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.use_chap_auth = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.volume_backend_name = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.volume_clear  = zero {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.volume_clear_ionice = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.volume_clear_size = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_reports.file_event_handler = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_reports.log_dir           = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.backend_availability_zone = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.backend_host         = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.chap_password        = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.chap_username        = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.chiscsi_conf         = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.disk_geometry        = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.driver_client_cert   = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.driver_client_cert_key = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.driver_data_namespace = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.driver_use_ssl       = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.extra_capabilities   = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.filter_function      = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.goodness_function    = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.iser_helper          = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.iser_ip_address      = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.iser_port            = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.iser_target_prefix   = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nas_host             = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nas_login            = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nas_mount_options    = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nas_password         = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nas_private_key      = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nas_share_path       = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nas_ssh_port         = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.num_shell_tries      = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.nvmet_port_id        = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack quobyte-client[87402]: Reading configuration file: /etc/quobyte/client.cfg
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack quobyte-client[87402]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.replication_device   = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.report_discard_supported = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.reserved_percentage  = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.scst_target_driver   = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.storage_protocol     = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.target_helper        = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.target_ip_address    = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.target_port          = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.target_prefix        = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.target_protocol      = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.trace_flags          = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.use_chap_auth        = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.volume_clear         = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.volume_clear_size    = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] QuobyteHD.volumes_dir          = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.ssl      = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_notifications.driver = [] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_notifications.retry = -1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] oslo_messaging_notifications.transport_url = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] key_manager.fixed_key          = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.barbican_api_version  = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.barbican_endpoint     = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.barbican_endpoint_type = public {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.barbican_region_name  = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.cafile                = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.certfile              = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.collect_timing        = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.insecure              = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.keyfile               = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.number_of_retries     = 60 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.retry_delay           = 1 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.send_service_user_token = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.split_loggers         = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.timeout               = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.verify_ssl            = True {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican.verify_ssl_path       = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican_service_user.auth_section = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican_service_user.auth_type = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican_service_user.cafile   = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican_service_user.certfile = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican_service_user.collect_timing = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican_service_user.insecure = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican_service_user.keyfile  = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican_service_user.split_loggers = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] barbican_service_user.timeout  = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.approle_role_id          = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.approle_secret_id        = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.auth_method              = approle {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.auth_path                = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.kv_mountpoint            = secret {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.kv_path                  = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.kv_version               = 2 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.namespace                = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.root_token_id            = **** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.ssl_ca_crt_file          = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.timeout                  = 60.0 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.token_file               = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.token_role               = None {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.use_ssl                  = False {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 17:48:42 devstack cinder-volume[87156]: DEBUG oslo_service.backend._eventlet.service [None req-8cb273e3-c18f-4aaa-9936-34342e31b49d None None] ******************************************************************************** {{(pid=87156) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 14 17:48:42 devstack sudo[87403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:48:42 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:48:43 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.238s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:48:43 devstack cinder-volume[87401]: INFO cinder.volume.driver [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Driver hasn't implemented _init_vendor_properties()
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG cinder.volume.driver [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87401) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG oslo_db.sqlalchemy.engines [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87401) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writer thread running {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG cinder.db.api [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Building query based on filter {{(pid=87401) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87401) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:48:43 devstack cinder-volume[87401]: INFO cinder.keymgr.migration [None req-a1b1ef80-dd74-4e8a-997f-9f4e08cc742f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 14 17:48:43 devstack sudo[87410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:48:43 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:48:43 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.231s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:48:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Driver initialization completed successfully.
Jul 14 17:48:43 devstack cinder-volume[87401]: INFO cinder.manager [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Initiating service 3 cleanup
Jul 14 17:48:43 devstack cinder-volume[87401]: INFO cinder.manager [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Service 3 cleanup completed.
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG cinder.service [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Creating RPC server for service cinder-volume {{(pid=87401) start /opt/stack/cinder/cinder/service.py:231}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG cinder.service [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87401) start /opt/stack/cinder/cinder/service.py:237}}
Jul 14 17:48:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:48:43 devstack sudo[87413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:48:43 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:48:43 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root
Jul 14 17:48:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.234s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:48:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-022ee9b5-eec8-4b4e-99d8-71ea5954b042 None None] Driver post RPC initialization completed successfully.
Jul 14 17:48:52 devstack cinder-volume[87156]: DEBUG dbcounter [-] [87156] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:48:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:48:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:49:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:49:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 6 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:49:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:49:42 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Flow 'volume_create_manager' (888d760a-263e-45b6-ba52-53f3edbe9dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdc80c6-3b24-4b58-a6ae-9a6447881f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdc80c6-3b24-4b58-a6ae-9a6447881f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1752219671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534cf3fe-9716-4dad-acf0-cabae084b883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379120ae0dd94fc7ae7c1fcb3322e7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:49:43Z,use_quota=True,user_id='c600648a3732452e878a4e94b830af8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110d7d7e-a1de-444b-a351-0e5b881b861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110d7d7e-a1de-444b-a351-0e5b881b861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b765a6ec-9db7-4513-97a8-61bbc548f64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b765a6ec-9db7-4513-97a8-61bbc548f64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '534cf3fe-9716-4dad-acf0-cabae084b883', 'volume_name': 'volume-534cf3fe-9716-4dad-acf0-cabae084b883', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5984481-c20c-4ad7-ac1e-e25e0153e5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5984481-c20c-4ad7-ac1e-e25e0153e5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d22a87-0b3c-49d2-9b71-4d101bb1eed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:49:43 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Volume 534cf3fe-9716-4dad-acf0-cabae084b883: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-534cf3fe-9716-4dad-acf0-cabae084b883', 'volume_size': 1}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1752219671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534cf3fe-9716-4dad-acf0-cabae084b883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379120ae0dd94fc7ae7c1fcb3322e7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:49:43Z,use_quota=True,user_id='c600648a3732452e878a4e94b830af8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Creating volume 534cf3fe-9716-4dad-acf0-cabae084b883 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:49:43 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:49:43 devstack sudo[87829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883 1073741824
Jul 14 17:49:43 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Flow 'volume_create_manager' (f43d9cc5-1421-4da2-b47a-7c09f16719e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e42e1f3-47ae-4654-beed-12fadc6ce6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e42e1f3-47ae-4654-beed-12fadc6ce6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1340054737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59de3f5a-adda-454b-b990-aa7cb8034cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763db6d9571e42c386983e4ac0d96f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:49:43Z,use_quota=True,user_id='db7fb9baa3cb4ea28c95f1e07388eb7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b330f48-953e-4543-b51e-e1fc1285396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b330f48-953e-4543-b51e-e1fc1285396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65dca1ac-4242-426f-91a7-5a95e6bb12a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65dca1ac-4242-426f-91a7-5a95e6bb12a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59de3f5a-adda-454b-b990-aa7cb8034cc5', 'volume_name': 'volume-59de3f5a-adda-454b-b990-aa7cb8034cc5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c342ebb1-f22e-47ff-b613-57e05baa4ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c342ebb1-f22e-47ff-b613-57e05baa4ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414ca8e0-e5fe-4bd6-a831-2fede687ebcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:49:43 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Volume 59de3f5a-adda-454b-b990-aa7cb8034cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59de3f5a-adda-454b-b990-aa7cb8034cc5', 'volume_size': 1}
Jul 14 17:49:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:49:44 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root
Jul 14 17:49:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883 1073741824" returned: 0 in 1.004s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:49:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:49:44 devstack sudo[88146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883
Jul 14 17:49:44 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:49:45 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883" returned: 0 in 0.817s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.380s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1340054737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59de3f5a-adda-454b-b990-aa7cb8034cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763db6d9571e42c386983e4ac0d96f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:49:43Z,use_quota=True,user_id='db7fb9baa3cb4ea28c95f1e07388eb7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Creating volume 59de3f5a-adda-454b-b990-aa7cb8034cc5 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:49:45 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d22a87-0b3c-49d2-9b71-4d101bb1eed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-534cf3fe-9716-4dad-acf0-cabae084b883', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da47751-cd89-4764-9ab1-4a970f1e7716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:49:45 devstack sudo[88149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5 1073741824
Jul 14 17:49:45 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:49:45 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Volume volume-534cf3fe-9716-4dad-acf0-cabae084b883 (534cf3fe-9716-4dad-acf0-cabae084b883): created successfully
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da47751-cd89-4764-9ab1-4a970f1e7716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:49:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Flow 'volume_create_manager' (888d760a-263e-45b6-ba52-53f3edbe9dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:49:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-beb38a82-0d39-49b9-a3c3-d382c1a54878 tempest-TaggedAttachmentsTest-1151472070 None] Created volume successfully.
Jul 14 17:49:46 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root
Jul 14 17:49:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5 1073741824" returned: 0 in 1.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:49:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:49:46 devstack sudo[88156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5
Jul 14 17:49:46 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:49:47 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root
Jul 14 17:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5" returned: 0 in 0.519s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:49:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414ca8e0-e5fe-4bd6-a831-2fede687ebcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59de3f5a-adda-454b-b990-aa7cb8034cc5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94dd789-85b9-47cf-a2e4-491bc51d62ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:49:47 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Volume volume-59de3f5a-adda-454b-b990-aa7cb8034cc5 (59de3f5a-adda-454b-b990-aa7cb8034cc5): created successfully
Jul 14 17:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94dd789-85b9-47cf-a2e4-491bc51d62ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:49:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Flow 'volume_create_manager' (f43d9cc5-1421-4da2-b47a-7c09f16719e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:49:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bdabb91a-73dd-4c71-ab43-dae198f1b5a8 tempest-DeleteServersTestJSON-382434531 None] Created volume successfully.
Jul 14 17:49:54 devstack cinder-volume[87401]: WARNING py.warnings [req-93ee80e9-ba78-4c77-a30d-26c9bc7bf5bf req-d0ca7f21-a6ce-429e-b696-4e84b57578b7 tempest-DeleteServersTestJSON-382434531 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Jul 14 17:49:54 devstack cinder-volume[87401]:   .first()
Jul 14 17:49:54 devstack cinder-volume[87401]: 
Jul 14 17:49:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-93ee80e9-ba78-4c77-a30d-26c9bc7bf5bf req-d0ca7f21-a6ce-429e-b696-4e84b57578b7 tempest-DeleteServersTestJSON-382434531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:49:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-93ee80e9-ba78-4c77-a30d-26c9bc7bf5bf req-d0ca7f21-a6ce-429e-b696-4e84b57578b7 tempest-DeleteServersTestJSON-382434531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:49:54 devstack cinder-volume[87401]: INFO oslo.privsep.daemon [req-93ee80e9-ba78-4c77-a30d-26c9bc7bf5bf req-d0ca7f21-a6ce-429e-b696-4e84b57578b7 tempest-DeleteServersTestJSON-382434531 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpf2hvalr5/privsep.sock']
Jul 14 17:49:54 devstack sudo[88270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpf2hvalr5/privsep.sock
Jul 14 17:49:54 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:49:56 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Jul 14 17:49:56 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 14 17:49:56 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 14 17:49:56 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 14 17:49:56 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 14 17:49:56 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 14 17:49:56 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 14 17:49:56 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 14 17:49:56 devstack cinder-volume[87401]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Jul 14 17:49:56 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root
Jul 14 17:49:56 devstack cinder-volume[87401]: INFO oslo.privsep.daemon [req-93ee80e9-ba78-4c77-a30d-26c9bc7bf5bf req-d0ca7f21-a6ce-429e-b696-4e84b57578b7 tempest-DeleteServersTestJSON-382434531 None] Spawned new privsep daemon via rootwrap
Jul 14 17:49:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [req-93ee80e9-ba78-4c77-a30d-26c9bc7bf5bf req-d0ca7f21-a6ce-429e-b696-4e84b57578b7 tempest-DeleteServersTestJSON-382434531 None] Accepted privsep connection to /tmp/tmpf2hvalr5/privsep.sock {{(pid=87401) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 14 17:49:56 devstack cinder-volume[87401]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 14 17:49:56 devstack cinder-volume[87401]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 14 17:49:56 devstack cinder-volume[87401]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 14 17:49:56 devstack cinder-volume[87401]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88276
Jul 14 17:49:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd542b56-a0de-4595-935f-6475c6db6196]: (2,) {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:49:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cde754-0c43-4515-bf41-510f32a16ee1]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:49:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-93ee80e9-ba78-4c77-a30d-26c9bc7bf5bf req-d0ca7f21-a6ce-429e-b696-4e84b57578b7 tempest-DeleteServersTestJSON-382434531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:49:56 devstack sudo[88279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5
Jul 14 17:49:56 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:49:57 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=8,cinder:SELECT=2,cinder:DELETE=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:49:57 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root
Jul 14 17:49:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-93ee80e9-ba78-4c77-a30d-26c9bc7bf5bf req-d0ca7f21-a6ce-429e-b696-4e84b57578b7 tempest-DeleteServersTestJSON-382434531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5" returned: 0 in 0.611s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:49:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-93ee80e9-ba78-4c77-a30d-26c9bc7bf5bf req-d0ca7f21-a6ce-429e-b696-4e84b57578b7 tempest-DeleteServersTestJSON-382434531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.612s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:49:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-93ee80e9-ba78-4c77-a30d-26c9bc7bf5bf req-d0ca7f21-a6ce-429e-b696-4e84b57578b7 tempest-DeleteServersTestJSON-382434531 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-59de3f5a-adda-454b-b990-aa7cb8034cc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79cf57f3-03d9-4a15-944d-5446b635c435', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:49:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-93ee80e9-ba78-4c77-a30d-26c9bc7bf5bf req-d0ca7f21-a6ce-429e-b696-4e84b57578b7 tempest-DeleteServersTestJSON-382434531 None] attachment_update completed successfully.
Jul 14 17:50:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-4a482cc8-9424-42ed-8d9e-3681fd20c866 req-be0a90ad-4f0c-4477-a535-b2b0f5f081a4 tempest-DeleteServersTestJSON-382434531 None] Terminate volume connection completed successfully.
Jul 14 17:50:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-4a482cc8-9424-42ed-8d9e-3681fd20c866 req-be0a90ad-4f0c-4477-a535-b2b0f5f081a4 tempest-DeleteServersTestJSON-382434531 None] Deleting attachment 79cf57f3-03d9-4a15-944d-5446b635c435. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:50:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Acquiring lock "cinder-59de3f5a-adda-454b-b990-aa7cb8034cc5-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:50:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Lock "cinder-59de3f5a-adda-454b-b990-aa7cb8034cc5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:50:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Acquiring lock "cinder-quobyte-59de3f5a-adda-454b-b990-aa7cb8034cc5" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:50:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Lock "cinder-quobyte-59de3f5a-adda-454b-b990-aa7cb8034cc5" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:50:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ade6980-9d2b-4632-961a-be3162237273]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:50:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:04 devstack sudo[88870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5
Jul 14 17:50:04 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:04 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5" returned: 0 in 0.502s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:04 devstack sudo[88891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5
Jul 14 17:50:04 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:04 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-59de3f5a-adda-454b-b990-aa7cb8034cc5" returned: 0 in 0.282s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Lock "cinder-quobyte-59de3f5a-adda-454b-b990-aa7cb8034cc5" released by "delete_volume" :: held 0.854s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:50:04 devstack cinder-volume[87401]: WARNING cinder.quota [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:50:04 devstack cinder-volume[87401]: WARNING cinder.quota [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:50:04 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Created reservations ['c13ec7ce-ce44-4806-bad5-9ccfbb6db762', '34275ca8-fe23-404f-a907-d2c911d8be3d', 'e733d998-6cf1-4f06-8039-616ecfd1bc1b', 'f5399622-a1de-4e0c-9cd4-750b9aba26c4'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:50:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:50:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:50:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:05 devstack sudo[88896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:50:05 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:05 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:05 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:50:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Deleted volume successfully.
Jul 14 17:50:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b165df-12db-4705-9fd5-466265db6f62 tempest-DeleteServersTestJSON-382434531 None] Lock "cinder-59de3f5a-adda-454b-b990-aa7cb8034cc5-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:50:11 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:50:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Flow 'volume_create_manager' (0b057390-be59-4de2-aeab-19b5fd488da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:50:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8e5743-95c9-472e-a717-ce5aba039cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8e5743-95c9-472e-a717-ce5aba039cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-700533393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d8180e-5045-41dd-bdd8-5fd5b5fc9139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64823980a4f3438099859ee2f61f7f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:50:12Z,use_quota=True,user_id='8dd656fded6b4da8adf3a31b415747e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a648c8af-36de-4d5d-81c8-ef9dea4ef298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a648c8af-36de-4d5d-81c8-ef9dea4ef298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c79646-5d47-45b0-9510-cb6fbbf9f44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c79646-5d47-45b0-9510-cb6fbbf9f44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d8180e-5045-41dd-bdd8-5fd5b5fc9139', 'volume_name': 'volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570c2529-a034-4137-8db7-ac7b9fd1d679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570c2529-a034-4137-8db7-ac7b9fd1d679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823f451f-83d1-4223-8b10-8724bb7d3c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:12 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Volume a9d8180e-5045-41dd-bdd8-5fd5b5fc9139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139', 'volume_size': 1}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-700533393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d8180e-5045-41dd-bdd8-5fd5b5fc9139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64823980a4f3438099859ee2f61f7f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:50:12Z,use_quota=True,user_id='8dd656fded6b4da8adf3a31b415747e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Creating volume a9d8180e-5045-41dd-bdd8-5fd5b5fc9139 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:50:12 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:12 devstack sudo[88911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139 1073741824
Jul 14 17:50:12 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:12 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139 1073741824" returned: 0 in 0.807s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:13 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139
Jul 14 17:50:13 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:13 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139" returned: 0 in 0.384s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:50:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823f451f-83d1-4223-8b10-8724bb7d3c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4abd545-1ce2-4f95-9758-7f745d2dee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:13 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Volume volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139 (a9d8180e-5045-41dd-bdd8-5fd5b5fc9139): created successfully
Jul 14 17:50:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4abd545-1ce2-4f95-9758-7f745d2dee54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Flow 'volume_create_manager' (0b057390-be59-4de2-aeab-19b5fd488da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:50:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8464e400-4afd-4a62-a6bc-b12e58847bca tempest-AttachVolumeShelveTestJSON-856956706 None] Created volume successfully.
Jul 14 17:50:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:50:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:50:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:50:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:20 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:50:20 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:21 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:50:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:50:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 8 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:50:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:50:23 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=13,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:50:23 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=20,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:50:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-27109b94-cd5f-4c49-acf6-4bbf56bf309e req-4ffd30dc-16bc-482b-a1f9-92cd56abb99d tempest-AttachVolumeShelveTestJSON-856956706 None] No connector for attachment 282c9e3b-4ace-49e8-8cd4-ee7c8e10f193; skipping storage backend terminate_connection call. {{(pid=87401) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 14 17:50:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-27109b94-cd5f-4c49-acf6-4bbf56bf309e req-4ffd30dc-16bc-482b-a1f9-92cd56abb99d tempest-AttachVolumeShelveTestJSON-856956706 None] Deleting attachment 282c9e3b-4ace-49e8-8cd4-ee7c8e10f193. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:50:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-22e7384b-3579-41e8-920c-d2220217efde tempest-GroupsTest-1695672011 None] Group tempest-Group1-477527986: creating
Jul 14 17:50:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-22e7384b-3579-41e8-920c-d2220217efde tempest-GroupsTest-1695672011 None] Group tempest-Group1-477527986: created successfully
Jul 14 17:50:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-22e7384b-3579-41e8-920c-d2220217efde tempest-GroupsTest-1695672011 None] Create group completed successfully.
Jul 14 17:50:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e7ddfe16-c82f-426c-9870-361570ed5959 tempest-GroupsTest-1695672011 None] Group tempest-Group2-145715287: creating
Jul 14 17:50:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e7ddfe16-c82f-426c-9870-361570ed5959 tempest-GroupsTest-1695672011 None] Group tempest-Group2-145715287: created successfully
Jul 14 17:50:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e7ddfe16-c82f-426c-9870-361570ed5959 tempest-GroupsTest-1695672011 None] Create group completed successfully.
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Flow 'volume_create_manager' (5cb55fc7-c09d-4faf-aa2d-43bfb17b4e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9688119a-ab02-4b2a-b970-0d25ee37b271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9688119a-ab02-4b2a-b970-0d25ee37b271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1637773016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=111e0e5a-8eec-4579-ad52-b2eb545e9f5d,host='devstack@QuobyteHD#QuobyteHD',id=357fedb5-b614-4729-a20d-d76df09af7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e6acfa2a5c4073b162443a0fd13ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:50:34Z,use_quota=True,user_id='7298e4c85f334149987a5ba3c2e6c1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249eb8bf-5317-44a1-bc0f-2444f6a76e0a),volume_type_id=249eb8bf-5317-44a1-bc0f-2444f6a76e0a)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a39668-4418-484e-94d5-7610ebeda359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a39668-4418-484e-94d5-7610ebeda359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8727c2cc-8f7b-4d53-bcf9-74347b648798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8727c2cc-8f7b-4d53-bcf9-74347b648798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '357fedb5-b614-4729-a20d-d76df09af7b9', 'volume_name': 'volume-357fedb5-b614-4729-a20d-d76df09af7b9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117fc852-836b-4ce5-a831-97c195dfe7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117fc852-836b-4ce5-a831-97c195dfe7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d0f10a-19cd-40b0-9861-f6154cf68505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:34 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Volume 357fedb5-b614-4729-a20d-d76df09af7b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-357fedb5-b614-4729-a20d-d76df09af7b9', 'volume_size': 1}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=111e0e5a-8eec-4579-ad52-b2eb545e9f5d,created_at=2026-07-14T15:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1637773016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=111e0e5a-8eec-4579-ad52-b2eb545e9f5d,host='devstack@QuobyteHD#QuobyteHD',id=357fedb5-b614-4729-a20d-d76df09af7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e6acfa2a5c4073b162443a0fd13ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:50:34Z,use_quota=True,user_id='7298e4c85f334149987a5ba3c2e6c1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(249eb8bf-5317-44a1-bc0f-2444f6a76e0a),volume_type_id=249eb8bf-5317-44a1-bc0f-2444f6a76e0a)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Creating volume 357fedb5-b614-4729-a20d-d76df09af7b9 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:50:34 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-357fedb5-b614-4729-a20d-d76df09af7b9 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:34 devstack sudo[89038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-357fedb5-b614-4729-a20d-d76df09af7b9 1073741824
Jul 14 17:50:34 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:34 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-357fedb5-b614-4729-a20d-d76df09af7b9 1073741824" returned: 0 in 0.587s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-357fedb5-b614-4729-a20d-d76df09af7b9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:34 devstack sudo[89046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-357fedb5-b614-4729-a20d-d76df09af7b9
Jul 14 17:50:34 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:35 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-357fedb5-b614-4729-a20d-d76df09af7b9" returned: 0 in 0.350s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:50:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d0f10a-19cd-40b0-9861-f6154cf68505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-357fedb5-b614-4729-a20d-d76df09af7b9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a345ef9b-f689-4535-82ca-2d586b4b18be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:35 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Volume volume-357fedb5-b614-4729-a20d-d76df09af7b9 (357fedb5-b614-4729-a20d-d76df09af7b9): created successfully
Jul 14 17:50:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a345ef9b-f689-4535-82ca-2d586b4b18be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Flow 'volume_create_manager' (5cb55fc7-c09d-4faf-aa2d-43bfb17b4e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:50:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-389c2f9f-52d6-4e45-a29c-df082f1aba0c tempest-GroupsTest-1695672011 None] Created volume successfully.
Jul 14 17:50:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Acquiring lock "cinder-quobyte-357fedb5-b614-4729-a20d-d76df09af7b9" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:50:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Lock "cinder-quobyte-357fedb5-b614-4729-a20d-d76df09af7b9" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:50:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e650366-06b7-491b-ba05-89e6c0c814d8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:50:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-357fedb5-b614-4729-a20d-d76df09af7b9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:38 devstack sudo[89083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-357fedb5-b614-4729-a20d-d76df09af7b9
Jul 14 17:50:38 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:38 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-357fedb5-b614-4729-a20d-d76df09af7b9" returned: 0 in 0.451s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-357fedb5-b614-4729-a20d-d76df09af7b9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:38 devstack sudo[89090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-357fedb5-b614-4729-a20d-d76df09af7b9
Jul 14 17:50:38 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:39 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-357fedb5-b614-4729-a20d-d76df09af7b9" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Lock "cinder-quobyte-357fedb5-b614-4729-a20d-d76df09af7b9" released by "delete_volume" :: held 0.852s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:50:39 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Created reservations ['724d84b9-96b3-45c8-bc5d-02aafe854092'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:50:39 devstack cinder-volume[87401]: WARNING cinder.quota [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-658960450 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-658960450, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:50:39 devstack cinder-volume[87401]: WARNING cinder.quota [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-658960450 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-658960450, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:50:39 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Created reservations ['22f973e7-57f3-44ce-b8a5-1123d15625a1', '72f0a67d-eff6-4a73-bab3-5cef4b113432', '193d8704-a70f-4425-a295-a6a8f4ea7cd8', '635ba87f-9d70-4a04-8ca3-ff0436849cd1'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:50:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:50:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:50:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:39 devstack sudo[89105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:50:39 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:40 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.431s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:40 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:50:40 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-60ef208c-15b2-4feb-97de-0e9ff2a74331 tempest-GroupsTest-1695672011 None] Delete group completed successfully.
Jul 14 17:50:40 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-294890a7-e1dd-423d-878b-7924f95d22fe tempest-GroupsTest-1695672011 None] Created reservations ['3e7a331b-0d7a-4551-8382-34ff332003f4'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-294890a7-e1dd-423d-878b-7924f95d22fe tempest-GroupsTest-1695672011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-294890a7-e1dd-423d-878b-7924f95d22fe tempest-GroupsTest-1695672011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-294890a7-e1dd-423d-878b-7924f95d22fe tempest-GroupsTest-1695672011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:50:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-294890a7-e1dd-423d-878b-7924f95d22fe tempest-GroupsTest-1695672011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-294890a7-e1dd-423d-878b-7924f95d22fe tempest-GroupsTest-1695672011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-294890a7-e1dd-423d-878b-7924f95d22fe tempest-GroupsTest-1695672011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:40 devstack sudo[89150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:50:40 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:40 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-294890a7-e1dd-423d-878b-7924f95d22fe tempest-GroupsTest-1695672011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.506s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:40 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-294890a7-e1dd-423d-878b-7924f95d22fe tempest-GroupsTest-1695672011 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:50:40 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-294890a7-e1dd-423d-878b-7924f95d22fe tempest-GroupsTest-1695672011 None] Delete group completed successfully.
Jul 14 17:50:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e59753ef-74d8-4d85-9cb8-6c77e8b7ed95 tempest-GroupsTest-1695672011 None] Group tempest-GroupsTest-Group-670687323: creating
Jul 14 17:50:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e59753ef-74d8-4d85-9cb8-6c77e8b7ed95 tempest-GroupsTest-1695672011 None] Group tempest-GroupsTest-Group-670687323: created successfully
Jul 14 17:50:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e59753ef-74d8-4d85-9cb8-6c77e8b7ed95 tempest-GroupsTest-1695672011 None] Create group completed successfully.
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Flow 'volume_create_manager' (9e2b92ab-bab8-4b83-99a5-9aacb4218170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610b2c31-53ec-4156-ad57-2e4f5e077d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610b2c31-53ec-4156-ad57-2e4f5e077d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391706915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f675011e-740c-4f0d-9860-f1967d8ce1c2,host='devstack@QuobyteHD#QuobyteHD',id=d9f97bae-2dc3-485d-a90c-b09f640e43cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e6acfa2a5c4073b162443a0fd13ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:50:45Z,use_quota=True,user_id='7298e4c85f334149987a5ba3c2e6c1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1626f14-01c5-42b9-ba69-e580f49538d5),volume_type_id=e1626f14-01c5-42b9-ba69-e580f49538d5)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbc4608-5ed0-4b7b-bfe5-f68b58317182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbc4608-5ed0-4b7b-bfe5-f68b58317182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165f148b-5811-4f2e-a9e9-ece4a23d93ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165f148b-5811-4f2e-a9e9-ece4a23d93ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f97bae-2dc3-485d-a90c-b09f640e43cf', 'volume_name': 'volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925cac24-4c25-4516-8a92-5d3f31699581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925cac24-4c25-4516-8a92-5d3f31699581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36f750b-2269-42aa-a365-eefcb56237d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:44 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Volume d9f97bae-2dc3-485d-a90c-b09f640e43cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf', 'volume_size': 1}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f675011e-740c-4f0d-9860-f1967d8ce1c2,created_at=2026-07-14T15:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391706915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f675011e-740c-4f0d-9860-f1967d8ce1c2,host='devstack@QuobyteHD#QuobyteHD',id=d9f97bae-2dc3-485d-a90c-b09f640e43cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e6acfa2a5c4073b162443a0fd13ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:50:45Z,use_quota=True,user_id='7298e4c85f334149987a5ba3c2e6c1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1626f14-01c5-42b9-ba69-e580f49538d5),volume_type_id=e1626f14-01c5-42b9-ba69-e580f49538d5)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Creating volume d9f97bae-2dc3-485d-a90c-b09f640e43cf {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:50:44 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:50:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:44 devstack sudo[89188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf 1073741824
Jul 14 17:50:44 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:45 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf 1073741824" returned: 0 in 0.614s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:45 devstack sudo[89194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf
Jul 14 17:50:45 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:46 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf" returned: 0 in 0.578s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:50:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36f750b-2269-42aa-a365-eefcb56237d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad195cc-db58-4cb3-b2b6-d8e1ba20394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:46 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Volume volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf (d9f97bae-2dc3-485d-a90c-b09f640e43cf): created successfully
Jul 14 17:50:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad195cc-db58-4cb3-b2b6-d8e1ba20394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Flow 'volume_create_manager' (9e2b92ab-bab8-4b83-99a5-9aacb4218170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:50:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cc7b3eef-31ea-4fec-a35f-4a2c799aa2bb tempest-GroupsTest-1695672011 None] Created volume successfully.
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Flow 'volume_create_manager' (38ffc9be-b118-41f6-80e2-2283477de66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7627f2c8-6694-4335-94ae-96d7ed72517f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7627f2c8-6694-4335-94ae-96d7ed72517f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1066553085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f675011e-740c-4f0d-9860-f1967d8ce1c2,host='devstack@QuobyteHD#QuobyteHD',id=4d8ae945-be26-4faf-a7c0-c230e63f9787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e6acfa2a5c4073b162443a0fd13ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:50:48Z,use_quota=True,user_id='7298e4c85f334149987a5ba3c2e6c1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1626f14-01c5-42b9-ba69-e580f49538d5),volume_type_id=e1626f14-01c5-42b9-ba69-e580f49538d5)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65664d63-f61b-4da4-826f-044240186e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65664d63-f61b-4da4-826f-044240186e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939dce1f-5bcc-440a-a95f-357eeb8495f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939dce1f-5bcc-440a-a95f-357eeb8495f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d8ae945-be26-4faf-a7c0-c230e63f9787', 'volume_name': 'volume-4d8ae945-be26-4faf-a7c0-c230e63f9787', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75b7c6d-cc86-483b-bf4f-4d7cd0c22afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75b7c6d-cc86-483b-bf4f-4d7cd0c22afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84209b8f-fd64-4ca4-9659-23e8819af138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:48 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Volume 4d8ae945-be26-4faf-a7c0-c230e63f9787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d8ae945-be26-4faf-a7c0-c230e63f9787', 'volume_size': 1}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f675011e-740c-4f0d-9860-f1967d8ce1c2,created_at=2026-07-14T15:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1066553085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f675011e-740c-4f0d-9860-f1967d8ce1c2,host='devstack@QuobyteHD#QuobyteHD',id=4d8ae945-be26-4faf-a7c0-c230e63f9787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e6acfa2a5c4073b162443a0fd13ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:50:48Z,use_quota=True,user_id='7298e4c85f334149987a5ba3c2e6c1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1626f14-01c5-42b9-ba69-e580f49538d5),volume_type_id=e1626f14-01c5-42b9-ba69-e580f49538d5)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Creating volume 4d8ae945-be26-4faf-a7c0-c230e63f9787 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:50:48 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d8ae945-be26-4faf-a7c0-c230e63f9787 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:48 devstack sudo[89254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d8ae945-be26-4faf-a7c0-c230e63f9787 1073741824
Jul 14 17:50:48 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7e970b50-2817-44ac-9548-e56f21e66f2e req-4f30956b-e005-40df-be12-befa30e5568f tempest-TaggedAttachmentsTest-1151472070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:49 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d8ae945-be26-4faf-a7c0-c230e63f9787 1073741824" returned: 0 in 0.537s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d8ae945-be26-4faf-a7c0-c230e63f9787 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:49 devstack sudo[89270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d8ae945-be26-4faf-a7c0-c230e63f9787
Jul 14 17:50:49 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:49 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d8ae945-be26-4faf-a7c0-c230e63f9787" returned: 0 in 0.261s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7e970b50-2817-44ac-9548-e56f21e66f2e req-4f30956b-e005-40df-be12-befa30e5568f tempest-TaggedAttachmentsTest-1151472070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.505s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84209b8f-fd64-4ca4-9659-23e8819af138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d8ae945-be26-4faf-a7c0-c230e63f9787', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0792bf-33fa-4073-b54e-82cd45b800ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[52510a2d-bd9f-4917-96d6-a9af1ecefd73]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7e970b50-2817-44ac-9548-e56f21e66f2e req-4f30956b-e005-40df-be12-befa30e5568f tempest-TaggedAttachmentsTest-1151472070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:49 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Volume volume-4d8ae945-be26-4faf-a7c0-c230e63f9787 (4d8ae945-be26-4faf-a7c0-c230e63f9787): created successfully
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0792bf-33fa-4073-b54e-82cd45b800ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Flow 'volume_create_manager' (38ffc9be-b118-41f6-80e2-2283477de66e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:50:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7c46c1ef-3a12-444b-9d35-e7db8fdd5556 tempest-GroupsTest-1695672011 None] Created volume successfully.
Jul 14 17:50:49 devstack sudo[89273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883
Jul 14 17:50:49 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:49 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7e970b50-2817-44ac-9548-e56f21e66f2e req-4f30956b-e005-40df-be12-befa30e5568f tempest-TaggedAttachmentsTest-1151472070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883" returned: 0 in 0.481s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7e970b50-2817-44ac-9548-e56f21e66f2e req-4f30956b-e005-40df-be12-befa30e5568f tempest-TaggedAttachmentsTest-1151472070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.511s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-27c092f3-549a-4802-ba5e-73e1cd3ab2a5 tempest-GroupsTest-1695672011 None] Update group completed successfully.
Jul 14 17:50:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-7e970b50-2817-44ac-9548-e56f21e66f2e req-4f30956b-e005-40df-be12-befa30e5568f tempest-TaggedAttachmentsTest-1151472070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-534cf3fe-9716-4dad-acf0-cabae084b883', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36ea271b-0279-4ee2-a5cc-36211581d0db', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:50:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-7e970b50-2817-44ac-9548-e56f21e66f2e req-4f30956b-e005-40df-be12-befa30e5568f tempest-TaggedAttachmentsTest-1151472070 None] attachment_update completed successfully.
Jul 14 17:50:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8111ced3-a961-404b-b463-5a9257992ea3 tempest-GroupsTest-1695672011 None] Update group completed successfully.
Jul 14 17:50:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Acquiring lock "cinder-quobyte-4d8ae945-be26-4faf-a7c0-c230e63f9787" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:50:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Lock "cinder-quobyte-4d8ae945-be26-4faf-a7c0-c230e63f9787" acquired by "delete_volume" :: waited 0.048s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:50:53 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ebf416-1fbb-48e8-8f12-1e5e04681e4d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:50:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d8ae945-be26-4faf-a7c0-c230e63f9787 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:53 devstack sudo[89674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d8ae945-be26-4faf-a7c0-c230e63f9787
Jul 14 17:50:53 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-bac22464-f108-483b-b90f-60753357b4cd req-b3927e9c-9e80-4fee-96a7-e08822ce12bb tempest-TaggedAttachmentsTest-1151472070 None] Terminate volume connection completed successfully.
Jul 14 17:50:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-bac22464-f108-483b-b90f-60753357b4cd req-b3927e9c-9e80-4fee-96a7-e08822ce12bb tempest-TaggedAttachmentsTest-1151472070 None] Deleting attachment 36ea271b-0279-4ee2-a5cc-36211581d0db. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:50:54 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d8ae945-be26-4faf-a7c0-c230e63f9787" returned: 0 in 0.576s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d8ae945-be26-4faf-a7c0-c230e63f9787 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:54 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d8ae945-be26-4faf-a7c0-c230e63f9787
Jul 14 17:50:54 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:54 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d8ae945-be26-4faf-a7c0-c230e63f9787" returned: 0 in 0.295s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Lock "cinder-quobyte-4d8ae945-be26-4faf-a7c0-c230e63f9787" released by "delete_volume" :: held 0.962s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:50:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Acquiring lock "cinder-quobyte-d9f97bae-2dc3-485d-a90c-b09f640e43cf" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:50:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Lock "cinder-quobyte-d9f97bae-2dc3-485d-a90c-b09f640e43cf" acquired by "delete_volume" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:50:54 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0726e248-e72d-442d-93a0-7eabe3e88d90]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:50:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:54 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf
Jul 14 17:50:54 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:55 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf" returned: 0 in 0.558s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:55 devstack sudo[89730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf
Jul 14 17:50:55 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:55 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d9f97bae-2dc3-485d-a90c-b09f640e43cf" returned: 0 in 0.280s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Lock "cinder-quobyte-d9f97bae-2dc3-485d-a90c-b09f640e43cf" released by "delete_volume" :: held 0.918s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Created reservations ['b0eaf7e7-e1e8-4ee0-96dd-ebe9e1ed4ba8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:50:55 devstack cinder-volume[87401]: WARNING cinder.quota [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-889977585 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-889977585, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:50:55 devstack cinder-volume[87401]: WARNING cinder.quota [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-889977585 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-889977585, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Created reservations ['7f2c2937-bfff-4bde-b419-a615e89b32b1', 'b5f8e2e5-5727-4b35-bbfb-a5b6d0dc7470', '720e3041-fc6a-420f-a92a-f2681f527a36', 'd6bf52e3-ccde-498f-8455-4634e7f3c58b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Created reservations ['d4293454-286f-40d2-a197-97e7eb22fe6c', '9e331168-6e1e-4f61-9bf8-98aef7c9144c', '6cc07743-377e-4706-9791-7a78e9032e9a', '0523fe1e-a3d7-4bfc-894a-48e727adac1d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:50:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:50:56 devstack sudo[89740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:50:56 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:50:56 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root
Jul 14 17:50:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.325s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:50:56 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:50:56 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-03751a47-a4ed-4127-b15b-6b71f0295709 tempest-GroupsTest-1695672011 None] Delete group completed successfully.
Jul 14 17:51:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Acquiring lock "cinder-534cf3fe-9716-4dad-acf0-cabae084b883-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Lock "cinder-534cf3fe-9716-4dad-acf0-cabae084b883-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Acquiring lock "cinder-quobyte-534cf3fe-9716-4dad-acf0-cabae084b883" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Lock "cinder-quobyte-534cf3fe-9716-4dad-acf0-cabae084b883" acquired by "delete_volume" :: waited 0.041s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95f8dce-8e53-44b4-a163-554d7a29fb45]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:51:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:05 devstack sudo[89823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883
Jul 14 17:51:05 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:05 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883" returned: 0 in 0.490s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:05 devstack sudo[89831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883
Jul 14 17:51:05 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:06 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-534cf3fe-9716-4dad-acf0-cabae084b883" returned: 0 in 0.602s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Lock "cinder-quobyte-534cf3fe-9716-4dad-acf0-cabae084b883" released by "delete_volume" :: held 1.161s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Created reservations ['aa60a4f6-871f-4f77-8668-066f18c0efac', '171df2c6-8511-437b-8d9d-323b2e92c473', 'fc36c825-19cd-475e-936c-a36c90c3b9cf', '1dbaa964-c4c6-4604-a02e-c1b323c5ea58'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:51:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:06 devstack sudo[89881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:51:06 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:07 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.603s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:07 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:51:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Deleted volume successfully.
Jul 14 17:51:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08e3536f-9447-4de7-b515-4397f7079600 tempest-TaggedAttachmentsTest-1151472070 None] Lock "cinder-534cf3fe-9716-4dad-acf0-cabae084b883-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Acquiring lock "cinder-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Lock "cinder-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Acquiring lock "cinder-quobyte-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Lock "cinder-quobyte-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d32143-e111-43b9-96e9-10806dc31930]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:51:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:09 devstack sudo[89907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139
Jul 14 17:51:09 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:09 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139" returned: 0 in 0.507s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:09 devstack sudo[89913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139
Jul 14 17:51:09 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:09 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139" returned: 0 in 0.415s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Lock "cinder-quobyte-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139" released by "delete_volume" :: held 0.988s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Created reservations ['6170bcd7-2d5d-4b4e-a809-5964145d9119', 'fe936473-795a-4be9-a357-fcb27499425a', '1554c59d-6f7b-40a6-92e9-2bae302cbebe', '16d0edb7-80d5-486a-b1af-d969adb07ec2'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:10 devstack sudo[89917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:51:10 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:10 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.332s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:51:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Deleted volume successfully.
Jul 14 17:51:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b9550dfd-0e3b-494e-a4b9-28c889fa5533 tempest-AttachVolumeShelveTestJSON-856956706 None] Lock "cinder-a9d8180e-5045-41dd-bdd8-5fd5b5fc9139-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Flow 'volume_create_manager' (368ce861-69c4-4937-ad7a-ecc5b70ca139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8336b4-44b8-4f2c-b4be-1c85a7fc9c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8336b4-44b8-4f2c-b4be-1c85a7fc9c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-419304889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd521db-1a3c-4bb2-aabf-5804601910c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6184e3c3aa02454f9d7901839ca34296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:51:13Z,use_quota=True,user_id='00a33850b7bc48c7a4fccf141f5a3cf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74794e64-1106-4ae6-897d-5aea39902b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74794e64-1106-4ae6-897d-5aea39902b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d364f7-23d1-458a-a1d9-76a14299ae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d364f7-23d1-458a-a1d9-76a14299ae9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd521db-1a3c-4bb2-aabf-5804601910c2', 'volume_name': 'volume-dfd521db-1a3c-4bb2-aabf-5804601910c2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6efa952-e613-4d9e-936c-6e79a82b0124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6efa952-e613-4d9e-936c-6e79a82b0124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaade6b1-642b-40db-9470-edd405c55b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:12 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Volume dfd521db-1a3c-4bb2-aabf-5804601910c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd521db-1a3c-4bb2-aabf-5804601910c2', 'volume_size': 1}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-419304889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd521db-1a3c-4bb2-aabf-5804601910c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6184e3c3aa02454f9d7901839ca34296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:51:13Z,use_quota=True,user_id='00a33850b7bc48c7a4fccf141f5a3cf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Creating volume dfd521db-1a3c-4bb2-aabf-5804601910c2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:51:12 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:51:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dfd521db-1a3c-4bb2-aabf-5804601910c2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:13 devstack sudo[89923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dfd521db-1a3c-4bb2-aabf-5804601910c2 1073741824
Jul 14 17:51:13 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:13 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dfd521db-1a3c-4bb2-aabf-5804601910c2 1073741824" returned: 0 in 0.647s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dfd521db-1a3c-4bb2-aabf-5804601910c2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:13 devstack sudo[89931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dfd521db-1a3c-4bb2-aabf-5804601910c2
Jul 14 17:51:13 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:14 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dfd521db-1a3c-4bb2-aabf-5804601910c2" returned: 0 in 0.624s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:51:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaade6b1-642b-40db-9470-edd405c55b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd521db-1a3c-4bb2-aabf-5804601910c2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90560d50-b386-4597-b12e-a1bf40d16bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:14 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Volume volume-dfd521db-1a3c-4bb2-aabf-5804601910c2 (dfd521db-1a3c-4bb2-aabf-5804601910c2): created successfully
Jul 14 17:51:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90560d50-b386-4597-b12e-a1bf40d16bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Flow 'volume_create_manager' (368ce861-69c4-4937-ad7a-ecc5b70ca139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:51:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b7184846-63a9-4877-bcdd-c511dd359139 tempest-VolumesAdminNegativeTest-264519324 None] Created volume successfully.
Jul 14 17:51:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Acquiring lock "cinder-dfd521db-1a3c-4bb2-aabf-5804601910c2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Lock "cinder-dfd521db-1a3c-4bb2-aabf-5804601910c2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Acquiring lock "cinder-quobyte-dfd521db-1a3c-4bb2-aabf-5804601910c2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Lock "cinder-quobyte-dfd521db-1a3c-4bb2-aabf-5804601910c2" acquired by "delete_volume" :: waited 0.061s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e960af3b-373e-4d02-be94-5140cac98391]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:51:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dfd521db-1a3c-4bb2-aabf-5804601910c2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:16 devstack sudo[89938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dfd521db-1a3c-4bb2-aabf-5804601910c2
Jul 14 17:51:16 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:16 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dfd521db-1a3c-4bb2-aabf-5804601910c2" returned: 0 in 0.443s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dfd521db-1a3c-4bb2-aabf-5804601910c2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:16 devstack sudo[89943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dfd521db-1a3c-4bb2-aabf-5804601910c2
Jul 14 17:51:16 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:16 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dfd521db-1a3c-4bb2-aabf-5804601910c2" returned: 0 in 0.301s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Lock "cinder-quobyte-dfd521db-1a3c-4bb2-aabf-5804601910c2" released by "delete_volume" :: held 0.806s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:16 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Created reservations ['28accf56-a9af-4473-ae9d-5527fcc164c9', '36a4a8b1-0317-4646-9934-c705b2274f1f', 'ca7ec7f0-df58-48ac-9b6d-655c40145f77', '12523dcc-534e-42d0-b84f-377ad32f9877'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:51:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:16 devstack sudo[89946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:51:16 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:17 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.435s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:17 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:51:17 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Deleted volume successfully.
Jul 14 17:51:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-befaa86f-46ac-4f4b-b9e9-c8dffd0173ad tempest-VolumesAdminNegativeTest-264519324 None] Lock "cinder-dfd521db-1a3c-4bb2-aabf-5804601910c2-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:51:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:20 devstack sudo[89979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:51:20 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:21 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.314s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Flow 'volume_create_manager' (c72a54d6-5a68-429e-970b-c2a92c4567e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e073116-609e-40c8-8593-4c636f75831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e073116-609e-40c8-8593-4c636f75831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-786953299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8768ec4-7329-4ea3-923b-b1dd824d94d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9531aeaad84ff682d5b4f50d133dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:51:22Z,use_quota=True,user_id='d320d77bebb14b02a642314404a25b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddf0e55-0feb-4650-87a3-2186d8176fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddf0e55-0feb-4650-87a3-2186d8176fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4c3d42-30fb-48b2-9414-6c2ce94e38c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4c3d42-30fb-48b2-9414-6c2ce94e38c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8768ec4-7329-4ea3-923b-b1dd824d94d8', 'volume_name': 'volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebdc7bd-b037-4245-b169-1d4911a1827e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebdc7bd-b037-4245-b169-1d4911a1827e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fe4568-225f-4412-a477-70904c21a705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Volume f8768ec4-7329-4ea3-923b-b1dd824d94d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8', 'volume_size': 1}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-786953299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8768ec4-7329-4ea3-923b-b1dd824d94d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9531aeaad84ff682d5b4f50d133dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:51:22Z,use_quota=True,user_id='d320d77bebb14b02a642314404a25b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Creating volume f8768ec4-7329-4ea3-923b-b1dd824d94d8 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:51:21 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:51:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:21 devstack sudo[89982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8 1073741824
Jul 14 17:51:21 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:22 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8 1073741824" returned: 0 in 0.509s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:22 devstack sudo[89988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8
Jul 14 17:51:22 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:22 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8" returned: 0 in 0.302s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:51:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fe4568-225f-4412-a477-70904c21a705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539f9d6f-78df-464a-869d-02fcf95eaa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Volume volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8 (f8768ec4-7329-4ea3-923b-b1dd824d94d8): created successfully
Jul 14 17:51:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539f9d6f-78df-464a-869d-02fcf95eaa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Flow 'volume_create_manager' (c72a54d6-5a68-429e-970b-c2a92c4567e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:51:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3f9f90fa-e513-4c97-9f1f-0e49dff8723b tempest-VolumesServicesTestJSON-1745367782 None] Created volume successfully.
Jul 14 17:51:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Acquiring lock "cinder-f8768ec4-7329-4ea3-923b-b1dd824d94d8-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Lock "cinder-f8768ec4-7329-4ea3-923b-b1dd824d94d8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:23 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=77,cinder:UPDATE=73,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:51:23 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=60,cinder:UPDATE=83,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:51:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Acquiring lock "cinder-quobyte-f8768ec4-7329-4ea3-923b-b1dd824d94d8" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Lock "cinder-quobyte-f8768ec4-7329-4ea3-923b-b1dd824d94d8" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8b137e-b1b0-42f8-aee1-a027c85d1bac]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:24 devstack sudo[89992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8
Jul 14 17:51:24 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:24 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8" returned: 0 in 0.428s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:24 devstack sudo[89997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8
Jul 14 17:51:24 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:24 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f8768ec4-7329-4ea3-923b-b1dd824d94d8" returned: 0 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Lock "cinder-quobyte-f8768ec4-7329-4ea3-923b-b1dd824d94d8" released by "delete_volume" :: held 0.845s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Created reservations ['c7069ef7-e588-4e39-9dd1-262a216f91b5', '6ade2d60-a0b5-497e-be32-bf1c37edaf5f', 'feb9bec0-cad3-4ecb-89bc-1efd07292d07', '02ec0df2-00b3-419b-8fc1-41729da60f2a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:25 devstack sudo[90000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:51:25 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:25 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.378s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:25 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:51:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Deleted volume successfully.
Jul 14 17:51:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b96fc668-3c05-42a0-9069-5b01e11654fc tempest-VolumesServicesTestJSON-1745367782 None] Lock "cinder-f8768ec4-7329-4ea3-923b-b1dd824d94d8-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:34 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:51:35 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Flow 'volume_create_manager' (eca01177-451c-4e06-922d-55f7ab9c1161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e46986-2a34-4eb2-b74d-878ed6995fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e46986-2a34-4eb2-b74d-878ed6995fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1134507840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4139b1d9-ccbd-41a1-8431-8993065c0c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e3fc25fe0f4d81acf321da2a6445df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:51:38Z,use_quota=True,user_id='eff1d03c989e40a5bfe8e6e13c00e108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1deaa6-2d36-4ccc-aae3-a817f1d8731b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1deaa6-2d36-4ccc-aae3-a817f1d8731b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222b7dfa-d09e-4e86-87a1-1e319d401a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222b7dfa-d09e-4e86-87a1-1e319d401a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4139b1d9-ccbd-41a1-8431-8993065c0c89', 'volume_name': 'volume-4139b1d9-ccbd-41a1-8431-8993065c0c89', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9b9046-024c-4bdd-9ad9-8f780196fcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9b9046-024c-4bdd-9ad9-8f780196fcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119a0842-088c-42ff-bfa9-37fe0aafcbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:37 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Volume 4139b1d9-ccbd-41a1-8431-8993065c0c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4139b1d9-ccbd-41a1-8431-8993065c0c89', 'volume_size': 1}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1134507840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4139b1d9-ccbd-41a1-8431-8993065c0c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e3fc25fe0f4d81acf321da2a6445df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:51:38Z,use_quota=True,user_id='eff1d03c989e40a5bfe8e6e13c00e108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Creating volume 4139b1d9-ccbd-41a1-8431-8993065c0c89 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:51:37 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:51:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4139b1d9-ccbd-41a1-8431-8993065c0c89 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:37 devstack sudo[90044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4139b1d9-ccbd-41a1-8431-8993065c0c89 1073741824
Jul 14 17:51:37 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:38 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4139b1d9-ccbd-41a1-8431-8993065c0c89 1073741824" returned: 0 in 0.491s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4139b1d9-ccbd-41a1-8431-8993065c0c89 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:38 devstack sudo[90051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4139b1d9-ccbd-41a1-8431-8993065c0c89
Jul 14 17:51:38 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:38 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4139b1d9-ccbd-41a1-8431-8993065c0c89" returned: 0 in 0.280s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:51:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119a0842-088c-42ff-bfa9-37fe0aafcbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4139b1d9-ccbd-41a1-8431-8993065c0c89', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2193faa8-92ed-4507-84de-15e801626816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:38 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Volume volume-4139b1d9-ccbd-41a1-8431-8993065c0c89 (4139b1d9-ccbd-41a1-8431-8993065c0c89): created successfully
Jul 14 17:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2193faa8-92ed-4507-84de-15e801626816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Flow 'volume_create_manager' (eca01177-451c-4e06-922d-55f7ab9c1161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:51:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2eaf4acd-49a2-45ed-8382-97d9283393d6 tempest-VolumesListAdminTestJSON-1044320379 None] Created volume successfully.
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Flow 'volume_create_manager' (40a54847-8cf4-4120-86bc-f92c65bebfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848b188b-0c43-4b12-b024-b8462b5511e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848b188b-0c43-4b12-b024-b8462b5511e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-549804450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e89fdb-7aaf-4d0c-b9e7-747133854ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e3fc25fe0f4d81acf321da2a6445df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:51:40Z,use_quota=True,user_id='eff1d03c989e40a5bfe8e6e13c00e108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eaa7bd5-8537-46f9-81d3-b5ea85214a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eaa7bd5-8537-46f9-81d3-b5ea85214a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903e5d4f-61c6-4d21-9a04-c06153ce7c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903e5d4f-61c6-4d21-9a04-c06153ce7c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e89fdb-7aaf-4d0c-b9e7-747133854ed3', 'volume_name': 'volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e89c8e-1905-47a0-9aba-8fabbc0280aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e89c8e-1905-47a0-9aba-8fabbc0280aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3765e409-3352-4c37-a083-65138fed2243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:40 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Volume 15e89fdb-7aaf-4d0c-b9e7-747133854ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3', 'volume_size': 1}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-549804450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e89fdb-7aaf-4d0c-b9e7-747133854ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e3fc25fe0f4d81acf321da2a6445df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:51:40Z,use_quota=True,user_id='eff1d03c989e40a5bfe8e6e13c00e108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Creating volume 15e89fdb-7aaf-4d0c-b9e7-747133854ed3 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:51:40 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:51:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:40 devstack sudo[90055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3 1073741824
Jul 14 17:51:40 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:41 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3 1073741824" returned: 0 in 0.522s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:41 devstack sudo[90061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3
Jul 14 17:51:41 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:41 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3" returned: 0 in 0.416s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:51:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3765e409-3352-4c37-a083-65138fed2243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c648dc89-6b81-44da-892a-28ce5374b3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:41 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Volume volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3 (15e89fdb-7aaf-4d0c-b9e7-747133854ed3): created successfully
Jul 14 17:51:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c648dc89-6b81-44da-892a-28ce5374b3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Flow 'volume_create_manager' (40a54847-8cf4-4120-86bc-f92c65bebfdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:51:41 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-460dd783-da3e-4fb7-8add-01fa1bcb0944 tempest-VolumesListAdminTestJSON-1044320379 None] Created volume successfully.
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Flow 'volume_create_manager' (794a421c-2ffa-47c6-a75d-f62e902e4f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2609ed7-f344-4725-9b34-ece6bf9d2250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2609ed7-f344-4725-9b34-ece6bf9d2250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1659873449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e3fc25fe0f4d81acf321da2a6445df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:51:43Z,use_quota=True,user_id='eff1d03c989e40a5bfe8e6e13c00e108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18e4f6c-a230-4885-b35e-f3a94308664d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18e4f6c-a230-4885-b35e-f3a94308664d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0ab5c5-8b77-43f2-9e98-d8b683fe635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0ab5c5-8b77-43f2-9e98-d8b683fe635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b', 'volume_name': 'volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30294fe1-223c-45f6-bcd2-022f8251a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30294fe1-223c-45f6-bcd2-022f8251a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adb06c6-b7f4-4e73-9b0f-a06a4192f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:43 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Volume 1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b', 'volume_size': 1}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1659873449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e3fc25fe0f4d81acf321da2a6445df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:51:43Z,use_quota=True,user_id='eff1d03c989e40a5bfe8e6e13c00e108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Creating volume 1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:51:43 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:51:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:43 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b 1073741824
Jul 14 17:51:43 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:44 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b 1073741824" returned: 0 in 0.810s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:44 devstack sudo[90084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b
Jul 14 17:51:44 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:45 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b" returned: 0 in 0.529s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:51:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adb06c6-b7f4-4e73-9b0f-a06a4192f52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2033b90f-093b-48f4-8085-bd7f35d37e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:45 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Volume volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b (1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b): created successfully
Jul 14 17:51:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2033b90f-093b-48f4-8085-bd7f35d37e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Flow 'volume_create_manager' (794a421c-2ffa-47c6-a75d-f62e902e4f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:51:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-76f71306-0c2d-4a5a-8c8d-f825fd0ea028 tempest-VolumesListAdminTestJSON-1044320379 None] Created volume successfully.
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Flow 'volume_create_manager' (7a10d3bb-b232-48a8-b455-d98f623ed204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358b1308-bdb2-472e-84b9-99c1edbbf795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358b1308-bdb2-472e-84b9-99c1edbbf795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b8db68-66e2-49aa-9c63-bb78761d1165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf70464e7b4a48de8101fd495b5f4523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:51:47Z,use_quota=True,user_id='bb58955722d04275aa570a22c3568789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449eb207-f0a8-49ba-a94b-e736b92ecd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449eb207-f0a8-49ba-a94b-e736b92ecd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb94f45-22e6-45de-8df3-8f83b5b46483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb94f45-22e6-45de-8df3-8f83b5b46483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b8db68-66e2-49aa-9c63-bb78761d1165', 'volume_name': 'volume-77b8db68-66e2-49aa-9c63-bb78761d1165', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f34154-b874-426b-93dc-08139dd77901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f34154-b874-426b-93dc-08139dd77901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e8cf01-32fb-4656-b9b6-6e15194771a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:47 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Volume 77b8db68-66e2-49aa-9c63-bb78761d1165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b8db68-66e2-49aa-9c63-bb78761d1165', 'volume_size': 1}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b8db68-66e2-49aa-9c63-bb78761d1165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf70464e7b4a48de8101fd495b5f4523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:51:47Z,use_quota=True,user_id='bb58955722d04275aa570a22c3568789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Creating volume 77b8db68-66e2-49aa-9c63-bb78761d1165 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:51:47 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:51:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-77b8db68-66e2-49aa-9c63-bb78761d1165 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:47 devstack sudo[90127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-77b8db68-66e2-49aa-9c63-bb78761d1165 1073741824
Jul 14 17:51:47 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:48 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-77b8db68-66e2-49aa-9c63-bb78761d1165 1073741824" returned: 0 in 0.571s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-77b8db68-66e2-49aa-9c63-bb78761d1165 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:48 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-77b8db68-66e2-49aa-9c63-bb78761d1165
Jul 14 17:51:48 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:48 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-77b8db68-66e2-49aa-9c63-bb78761d1165" returned: 0 in 0.330s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:51:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e8cf01-32fb-4656-b9b6-6e15194771a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b8db68-66e2-49aa-9c63-bb78761d1165', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff5166c-8fe9-4393-90b3-f872f78438e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:51:48 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Volume volume-77b8db68-66e2-49aa-9c63-bb78761d1165 (77b8db68-66e2-49aa-9c63-bb78761d1165): created successfully
Jul 14 17:51:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff5166c-8fe9-4393-90b3-f872f78438e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:51:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Flow 'volume_create_manager' (7a10d3bb-b232-48a8-b455-d98f623ed204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:51:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-622ca5c7-fab4-41cf-8134-91153fd668e9 tempest-VolumesListAdminTestJSON-1384339776 None] Created volume successfully.
Jul 14 17:51:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Acquiring lock "cinder-77b8db68-66e2-49aa-9c63-bb78761d1165-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Lock "cinder-77b8db68-66e2-49aa-9c63-bb78761d1165-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Acquiring lock "cinder-quobyte-77b8db68-66e2-49aa-9c63-bb78761d1165" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Lock "cinder-quobyte-77b8db68-66e2-49aa-9c63-bb78761d1165" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d8dfd3-df20-4470-b882-0058d1d89675]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:51:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-77b8db68-66e2-49aa-9c63-bb78761d1165 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "cinder-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "cinder-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:49 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-77b8db68-66e2-49aa-9c63-bb78761d1165
Jul 14 17:51:49 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "cinder-quobyte-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "cinder-quobyte-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5844d75-62cb-4d95-953f-7c0d57f49540]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:50 devstack sudo[90159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b
Jul 14 17:51:50 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:50 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-77b8db68-66e2-49aa-9c63-bb78761d1165" returned: 0 in 0.580s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-77b8db68-66e2-49aa-9c63-bb78761d1165 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:50 devstack sudo[90164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-77b8db68-66e2-49aa-9c63-bb78761d1165
Jul 14 17:51:50 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:50 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b" returned: 0 in 0.557s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:50 devstack sudo[90169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b
Jul 14 17:51:50 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:50 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-77b8db68-66e2-49aa-9c63-bb78761d1165" returned: 0 in 0.438s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Lock "cinder-quobyte-77b8db68-66e2-49aa-9c63-bb78761d1165" released by "delete_volume" :: held 1.109s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:50 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Created reservations ['e3c1e191-98d6-47e0-b312-9e2dc1f034e6', '1d7dbdea-fc22-4fb2-bc18-0bd1990364f4', 'ba5b6f87-23df-4456-b318-43acae4dbec9', 'b0c54fee-9362-4b4c-9cfa-41d661dbd7ac'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:51:51 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "cinder-quobyte-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b" released by "delete_volume" :: held 1.013s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:51 devstack sudo[90173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:51:51 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Created reservations ['9ad5f0df-f0f7-47ef-820a-7466978ac7bd', '4835660c-f748-4753-9595-283f99c53b09', '57f0d483-ba09-4819-b026-5f58bb02005c', 'f50f444f-9de9-4b3f-91da-31152655f527'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:51 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.427s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:51:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Deleted volume successfully.
Jul 14 17:51:51 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:51:51 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0b3bf0e8-0485-47be-a494-a89e12c6e9b0 tempest-VolumesListAdminTestJSON-1384339776 None] Lock "cinder-77b8db68-66e2-49aa-9c63-bb78761d1165-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:51 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.531s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:51 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:51:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Deleted volume successfully.
Jul 14 17:51:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ccc7c1e0-a496-4d9a-82f3-e757dd162705 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "cinder-1c49ea4e-8ef9-4ed9-8c9b-32f2d387b35b-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "cinder-15e89fdb-7aaf-4d0c-b9e7-747133854ed3-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "cinder-15e89fdb-7aaf-4d0c-b9e7-747133854ed3-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "cinder-quobyte-15e89fdb-7aaf-4d0c-b9e7-747133854ed3" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "cinder-quobyte-15e89fdb-7aaf-4d0c-b9e7-747133854ed3" acquired by "delete_volume" :: waited 0.041s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5a3d1e-9bb0-4275-8540-da1f6e2a3360]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:51:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:53 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3
Jul 14 17:51:53 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:54 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3" returned: 0 in 1.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:54 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3
Jul 14 17:51:54 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:55 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15e89fdb-7aaf-4d0c-b9e7-747133854ed3" returned: 0 in 0.879s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "cinder-quobyte-15e89fdb-7aaf-4d0c-b9e7-747133854ed3" released by "delete_volume" :: held 2.281s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:55 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Created reservations ['92ae46a3-9c9f-4807-b7bb-a248544a30c7', '569b5bf5-ddcd-4b89-bdbc-a6e120dbf2c1', 'b67e9814-1410-408b-b829-339ad759a93d', '2d643128-1563-42c8-956b-7017e8d5e5a7'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:51:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:55 devstack sudo[90329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:51:55 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:56 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.707s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:56 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:51:56 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Deleted volume successfully.
Jul 14 17:51:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c971e742-dd4f-4c50-b046-780810a89b81 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "cinder-15e89fdb-7aaf-4d0c-b9e7-747133854ed3-delete_volume" released by "delete_volume" :: held 3.776s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "cinder-4139b1d9-ccbd-41a1-8431-8993065c0c89-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "cinder-4139b1d9-ccbd-41a1-8431-8993065c0c89-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "cinder-quobyte-4139b1d9-ccbd-41a1-8431-8993065c0c89" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:51:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "cinder-quobyte-4139b1d9-ccbd-41a1-8431-8993065c0c89" acquired by "delete_volume" :: waited 0.070s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:51:57 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd5328c-77ee-46cc-bd56-29d854f47dc1]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:51:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4139b1d9-ccbd-41a1-8431-8993065c0c89 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:57 devstack sudo[90359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4139b1d9-ccbd-41a1-8431-8993065c0c89
Jul 14 17:51:57 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:58 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4139b1d9-ccbd-41a1-8431-8993065c0c89" returned: 0 in 1.118s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4139b1d9-ccbd-41a1-8431-8993065c0c89 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:58 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4139b1d9-ccbd-41a1-8431-8993065c0c89
Jul 14 17:51:58 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:51:59 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Jul 14 17:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4139b1d9-ccbd-41a1-8431-8993065c0c89" returned: 0 in 0.737s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:51:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "cinder-quobyte-4139b1d9-ccbd-41a1-8431-8993065c0c89" released by "delete_volume" :: held 2.006s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:51:59 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Created reservations ['b06154f1-fee1-4533-aa08-af5af5f89c6f', '6d870ec5-9b35-4bd6-9102-45e45cf02c86', '162ed90d-8508-432b-8251-5fb6abd48c54', 'c8a15dd0-b309-4f7c-896b-4ad17586eeaf'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:51:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:51:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:51:59 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:51:59 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:00 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.953s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:00 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:52:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Deleted volume successfully.
Jul 14 17:52:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f30c5628-30c6-435a-b93a-6dc9aa113e87 tempest-VolumesListAdminTestJSON-1044320379 None] Lock "cinder-4139b1d9-ccbd-41a1-8431-8993065c0c89-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:52:09 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=29,cinder:UPDATE=42,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:52:10 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=46,cinder:SELECT=27,cinder:INSERT=14,cinder:DELETE=6 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Flow 'volume_create_manager' (35fab7c6-48c2-4d46-8fca-86e32d20576e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32916a8f-9e01-498e-b322-fea64356a8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32916a8f-9e01-498e-b322-fea64356a8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1451671344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0e96a3-44c2-4493-bd85-c86a20dd15e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe96d1cf581433fb573bf929f02f2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:52:13Z,use_quota=True,user_id='1742039cb3a3451cb0d542262b346d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d81be2-d269-417b-bcdb-f18e2d39adec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d81be2-d269-417b-bcdb-f18e2d39adec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3d939f-50fa-4944-8824-b6cb3d9e5af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3d939f-50fa-4944-8824-b6cb3d9e5af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0e96a3-44c2-4493-bd85-c86a20dd15e9', 'volume_name': 'volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c92f0bb-47f5-407a-b359-af97653f1fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c92f0bb-47f5-407a-b359-af97653f1fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a3f318-d0f1-44c2-b8a8-93edf74cf3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:13 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Volume ee0e96a3-44c2-4493-bd85-c86a20dd15e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9', 'volume_size': 1}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1451671344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0e96a3-44c2-4493-bd85-c86a20dd15e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe96d1cf581433fb573bf929f02f2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:52:13Z,use_quota=True,user_id='1742039cb3a3451cb0d542262b346d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Creating volume ee0e96a3-44c2-4493-bd85-c86a20dd15e9 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:52:13 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:13 devstack sudo[90499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9 1073741824
Jul 14 17:52:13 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:13 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9 1073741824" returned: 0 in 0.663s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:52:14 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9
Jul 14 17:52:14 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Flow 'volume_create_manager' (51343a45-75d3-4586-abbe-ddae43ffc71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcd5fe4-42bd-4a10-843d-c082664bc738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bcd5fe4-42bd-4a10-843d-c082664bc738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1889747835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f122deaf-ef6e-4eb4-8c21-e2c81b191c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b1b40dcdd845e9be1758e79a87b3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:52:14Z,use_quota=True,user_id='c840df3307d44621831fbc01606875ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525d7c8f-1169-4ee7-a0d6-d3cb4756846a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525d7c8f-1169-4ee7-a0d6-d3cb4756846a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8193ba1-ebdc-431a-959b-4b10ed6a7212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8193ba1-ebdc-431a-959b-4b10ed6a7212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f122deaf-ef6e-4eb4-8c21-e2c81b191c0d', 'volume_name': 'volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ba9b25-4550-4dc4-97ec-fc56b87b6f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ba9b25-4550-4dc4-97ec-fc56b87b6f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a72a11d-1e9f-41ff-bcf8-f290328e76fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:14 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Volume f122deaf-ef6e-4eb4-8c21-e2c81b191c0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d', 'volume_size': 1}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:14 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9" returned: 0 in 0.289s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.139s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1889747835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f122deaf-ef6e-4eb4-8c21-e2c81b191c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b1b40dcdd845e9be1758e79a87b3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:52:14Z,use_quota=True,user_id='c840df3307d44621831fbc01606875ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Creating volume f122deaf-ef6e-4eb4-8c21-e2c81b191c0d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:52:14 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a3f318-d0f1-44c2-b8a8-93edf74cf3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:14 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d 1073741824
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b66de30-c45f-4b2c-8a47-8b4971f8a236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:14 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:14 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Volume volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9 (ee0e96a3-44c2-4493-bd85-c86a20dd15e9): created successfully
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b66de30-c45f-4b2c-8a47-8b4971f8a236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Flow 'volume_create_manager' (35fab7c6-48c2-4d46-8fca-86e32d20576e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:52:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e02b9411-145f-4397-a4fc-ff04803c1b40 tempest-VolumesTransfersTest-1575365326 None] Created volume successfully.
Jul 14 17:52:14 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d 1073741824" returned: 0 in 0.441s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:14 devstack sudo[90516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d
Jul 14 17:52:14 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:15 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:52:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a72a11d-1e9f-41ff-bcf8-f290328e76fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633f9438-92e4-4434-9126-2aa1dbad578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:15 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Volume volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d (f122deaf-ef6e-4eb4-8c21-e2c81b191c0d): created successfully
Jul 14 17:52:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633f9438-92e4-4434-9126-2aa1dbad578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Flow 'volume_create_manager' (51343a45-75d3-4586-abbe-ddae43ffc71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:52:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-57511ca0-c469-48dd-a9ef-43e4bfe299cf tempest-ServerRescueNegativeTestJSON-65708247 None] Created volume successfully.
Jul 14 17:52:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6083abbf-8617-47c8-97a5-a6c820639eec tempest-VolumesTransfersTest-351008329 None] Transfer volume completed successfully.
Jul 14 17:52:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Acquiring lock "cinder-ee0e96a3-44c2-4493-bd85-c86a20dd15e9-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:52:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Lock "cinder-ee0e96a3-44c2-4493-bd85-c86a20dd15e9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:52:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Acquiring lock "cinder-quobyte-ee0e96a3-44c2-4493-bd85-c86a20dd15e9" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:52:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Lock "cinder-quobyte-ee0e96a3-44c2-4493-bd85-c86a20dd15e9" acquired by "delete_volume" :: waited 0.043s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:52:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c65cfb6-c87d-43a6-a546-13f7965ab159]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:52:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:17 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9
Jul 14 17:52:17 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:18 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9" returned: 0 in 0.596s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:18 devstack sudo[90541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9
Jul 14 17:52:18 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:18 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ee0e96a3-44c2-4493-bd85-c86a20dd15e9" returned: 0 in 0.547s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Lock "cinder-quobyte-ee0e96a3-44c2-4493-bd85-c86a20dd15e9" released by "delete_volume" :: held 1.233s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:52:19 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Created reservations ['73033420-ce33-4fa7-abea-8b83e8475651', '82424f92-a1b3-4952-b9d9-f089b3bfc209', 'f201f6a2-dcf4-4bea-b1dd-f7f49a1f0dd6', '01fc8564-c9de-4b2b-b950-a8fe3d6c045b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:52:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:19 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:52:19 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:19 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.380s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:19 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:52:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Deleted volume successfully.
Jul 14 17:52:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8806a3ce-3adc-4d72-8f33-3ff9573e693d tempest-VolumesTransfersTest-1509463017 None] Lock "cinder-ee0e96a3-44c2-4493-bd85-c86a20dd15e9-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:52:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:52:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:20 devstack sudo[90572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:52:20 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Flow 'volume_create_manager' (0c9701d7-b59c-428d-b3a3-9685c4f15b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d5655a-18e6-4b46-9252-6187fb638000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d5655a-18e6-4b46-9252-6187fb638000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2016277182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe96d1cf581433fb573bf929f02f2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:52:21Z,use_quota=True,user_id='1742039cb3a3451cb0d542262b346d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd62435b-b806-4e9a-a5f0-08b07b32e0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd62435b-b806-4e9a-a5f0-08b07b32e0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a26a812-311c-4c2c-b76f-6c413f3cb8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a26a812-311c-4c2c-b76f-6c413f3cb8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5', 'volume_name': 'volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015f3b59-0b34-40a1-867f-df17aba3854b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015f3b59-0b34-40a1-867f-df17aba3854b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:21 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55b04cf-8a63-4a12-bfe4-a4b804872878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Volume b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5', 'volume_size': 1}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2016277182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe96d1cf581433fb573bf929f02f2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:52:21Z,use_quota=True,user_id='1742039cb3a3451cb0d542262b346d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Creating volume b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:52:21 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.571s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 8 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:52:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:52:21 devstack sudo[90577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5 1073741824
Jul 14 17:52:21 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:52:22 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Flow 'volume_create_manager' (01878443-93c3-4574-a924-e9c151f6d3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b6d5df-c6d5-46bd-8fd1-469f390e2d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5 1073741824" returned: 0 in 1.052s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b6d5df-c6d5-46bd-8fd1-469f390e2d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-98022128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5410c631-9ad6-4593-9ebd-2e8ec8c470b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f392491ab1a420387685deb09b63019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:52:22Z,use_quota=True,user_id='ce44e00e10a041158f9654b04abedc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b052b1-57ab-417f-abf4-7994c09281fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b052b1-57ab-417f-abf4-7994c09281fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a67145-f196-4d44-b02b-c262793a3d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a67145-f196-4d44-b02b-c262793a3d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5410c631-9ad6-4593-9ebd-2e8ec8c470b5', 'volume_name': 'volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4716e1b1-9c4c-44e8-ad51-26f0cae97035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4716e1b1-9c4c-44e8-ad51-26f0cae97035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a823b5bb-74e7-4f04-91c9-60ffd237d6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Volume 5410c631-9ad6-4593-9ebd-2e8ec8c470b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5', 'volume_size': 1}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:22 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5
Jul 14 17:52:22 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:22 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5" returned: 0 in 0.435s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:52:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-98022128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5410c631-9ad6-4593-9ebd-2e8ec8c470b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f392491ab1a420387685deb09b63019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:52:22Z,use_quota=True,user_id='ce44e00e10a041158f9654b04abedc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Creating volume 5410c631-9ad6-4593-9ebd-2e8ec8c470b5 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:52:23 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55b04cf-8a63-4a12-bfe4-a4b804872878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:23 devstack sudo[90589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5 1073741824
Jul 14 17:52:23 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee7f38b-8f73-4ea2-98ed-07f6428b0972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Volume volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5 (b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5): created successfully
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee7f38b-8f73-4ea2-98ed-07f6428b0972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Flow 'volume_create_manager' (0c9701d7-b59c-428d-b3a3-9685c4f15b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:52:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cea56458-6432-4597-a301-e70fd0a7ef8a tempest-VolumesTransfersTest-1575365326 None] Created volume successfully.
Jul 14 17:52:23 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5 1073741824" returned: 0 in 0.830s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:23 devstack sudo[90606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5
Jul 14 17:52:23 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:24 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5" returned: 0 in 0.486s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:52:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a823b5bb-74e7-4f04-91c9-60ffd237d6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ea2dda-5a11-42d2-b208-c584a2e9a614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:24 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Volume volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5 (5410c631-9ad6-4593-9ebd-2e8ec8c470b5): created successfully
Jul 14 17:52:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ea2dda-5a11-42d2-b208-c584a2e9a614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Flow 'volume_create_manager' (01878443-93c3-4574-a924-e9c151f6d3bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:52:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bddf785d-3d3b-4de5-8e9c-3aaf3841efb7 tempest-AttachVolumeNegativeTest-313902525 None] Created volume successfully.
Jul 14 17:52:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Acquiring lock "cinder-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:52:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Lock "cinder-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:52:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Acquiring lock "cinder-quobyte-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:52:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Lock "cinder-quobyte-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:52:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cdbc2f-81b3-403f-811e-73114ed14ab7]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:25 devstack sudo[90632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5
Jul 14 17:52:25 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:25 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5" returned: 0 in 0.594s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:25 devstack sudo[90642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5
Jul 14 17:52:25 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:26 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5" returned: 0 in 1.000s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Lock "cinder-quobyte-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5" released by "delete_volume" :: held 1.705s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:52:26 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Created reservations ['8558e468-6fec-4f45-839d-31f9e7c5cc44', '8b493cd9-c0fa-495d-b73a-1e9a20c7d890', '6ae6746d-190c-4a49-89b8-29f9753f457f', '66c78830-5fbf-47e0-aa91-b9ff44083e79'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:27 devstack sudo[90697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:52:27 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:27 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.383s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:52:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Deleted volume successfully.
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92a24ab2-0dee-4e42-b36e-2154ec4e7270 tempest-VolumesTransfersTest-1509463017 None] Lock "cinder-b4803f5b-36cc-4ca1-8020-d7cf4e3fe2e5-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-701c762f-9192-4174-bcfc-899eeace75ed req-a118431b-634c-4cf2-99cc-202d69717303 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-701c762f-9192-4174-bcfc-899eeace75ed req-a118431b-634c-4cf2-99cc-202d69717303 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbc509b-0190-49a5-ad70-52e3d0317873]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-701c762f-9192-4174-bcfc-899eeace75ed req-a118431b-634c-4cf2-99cc-202d69717303 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Acquiring lock "cinder-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:52:28 devstack sudo[90715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5
Jul 14 17:52:28 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Lock "cinder-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:52:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Acquiring lock "cinder-quobyte-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:52:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Lock "cinder-quobyte-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d" acquired by "delete_volume" :: waited 0.043s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:52:28 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d004d6a-2997-4cf8-aa4d-c0e98459d17f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:52:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:28 devstack sudo[90722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d
Jul 14 17:52:28 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:28 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-701c762f-9192-4174-bcfc-899eeace75ed req-a118431b-634c-4cf2-99cc-202d69717303 tempest-AttachVolumeNegativeTest-313902525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5" returned: 0 in 1.095s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-701c762f-9192-4174-bcfc-899eeace75ed req-a118431b-634c-4cf2-99cc-202d69717303 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.144s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-701c762f-9192-4174-bcfc-899eeace75ed req-a118431b-634c-4cf2-99cc-202d69717303 tempest-AttachVolumeNegativeTest-313902525 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff455a71-bf53-45db-9187-e7b7aca712bd', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:52:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-701c762f-9192-4174-bcfc-899eeace75ed req-a118431b-634c-4cf2-99cc-202d69717303 tempest-AttachVolumeNegativeTest-313902525 None] attachment_update completed successfully.
Jul 14 17:52:29 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d" returned: 0 in 0.679s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:29 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d
Jul 14 17:52:29 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:29 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d" returned: 0 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Lock "cinder-quobyte-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d" released by "delete_volume" :: held 1.158s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:52:29 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Created reservations ['dcb6b21e-2162-4af0-9b3d-9805a6806f05', '5c381061-91c4-404d-893a-ddd7a5c81c92', 'b665f77d-17b6-48ec-8aac-f9af585c2e08', '57bfc195-4cb7-4b2b-9b98-ef252d4dab67'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:52:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:52:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:52:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:29 devstack sudo[91116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:52:29 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:30 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:30 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:52:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Deleted volume successfully.
Jul 14 17:52:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c75d64e5-b409-4789-bcc2-774ac30a8f67 tempest-ServerRescueNegativeTestJSON-65708247 None] Lock "cinder-f122deaf-ef6e-4eb4-8c21-e2c81b191c0d-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:52:39 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=39,cinder:SELECT=28,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:52:40 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=30,cinder:UPDATE=36,cinder:INSERT=4,cinder:DELETE=5 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Flow 'volume_create_manager' (c896745b-5733-46cf-a733-705fcbc1c34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5accf021-67ce-4e46-a1f6-2bfb57c9f3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5accf021-67ce-4e46-a1f6-2bfb57c9f3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-317120379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ce7b091183446995440f3c113e4b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:52:43Z,use_quota=True,user_id='30938091f7c24a80b7bded4d86928f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcaddc81-6553-4a1e-896a-0c57d3ff4841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcaddc81-6553-4a1e-896a-0c57d3ff4841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ff4932-ade9-4a2e-acdd-9726bd6e633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ff4932-ade9-4a2e-acdd-9726bd6e633f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb', 'volume_name': 'volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d292b4f-c54a-4088-84e6-dd373175d6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d292b4f-c54a-4088-84e6-dd373175d6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32c1534-af90-4865-9f29-f329d66236ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:43 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Volume 26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb', 'volume_size': 1}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-317120379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ce7b091183446995440f3c113e4b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:52:43Z,use_quota=True,user_id='30938091f7c24a80b7bded4d86928f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Creating volume 26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:52:43 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:52:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:43 devstack sudo[91324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb 1073741824
Jul 14 17:52:43 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:44 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb 1073741824" returned: 0 in 0.697s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:44 devstack sudo[91333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb
Jul 14 17:52:44 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:44 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb" returned: 0 in 0.365s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:52:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32c1534-af90-4865-9f29-f329d66236ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaba32b4-6d06-46b3-a48e-6293171c851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:44 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Volume volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb (26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb): created successfully
Jul 14 17:52:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaba32b4-6d06-46b3-a48e-6293171c851e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Flow 'volume_create_manager' (c896745b-5733-46cf-a733-705fcbc1c34c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:52:44 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6853e21a-0a56-48dc-8fe3-e28a42314532 tempest-VolumesTransfersV355Test-477052652 None] Created volume successfully.
Jul 14 17:52:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fd603b82-7e94-44f8-98ed-9322a81c1d24 tempest-VolumesTransfersV355Test-1618850413 None] Transfer volume completed successfully.
Jul 14 17:52:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Acquiring lock "cinder-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:52:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Lock "cinder-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:52:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Acquiring lock "cinder-quobyte-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:52:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Lock "cinder-quobyte-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb" acquired by "delete_volume" :: waited 0.057s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:52:47 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81f5cda-3667-4cc7-bfb3-38482f679210]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:52:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:47 devstack sudo[91379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb
Jul 14 17:52:47 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:48 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb" returned: 0 in 0.606s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:48 devstack sudo[91404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb
Jul 14 17:52:48 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:48 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb" returned: 0 in 0.496s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Lock "cinder-quobyte-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb" released by "delete_volume" :: held 1.204s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:52:48 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Created reservations ['68e7c45b-ac60-4d42-9988-b07ff791ba23', 'f900d314-21cd-4dcc-8c1a-7c3c8c73721d', '9c7ee1ef-5ea2-441a-b700-4d56f6d34b6e', '5580c262-fc6a-4cf0-9225-227edd81858b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:52:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:52:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:52:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:49 devstack sudo[91411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:52:49 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:49 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.333s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:49 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:52:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Deleted volume successfully.
Jul 14 17:52:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9067814f-3bd8-430a-a003-9e47bf3d8697 tempest-VolumesTransfersV355Test-1000967551 None] Lock "cinder-26f2f2be-dfcb-4dae-99c5-cd66e4b73bbb-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Flow 'volume_create_manager' (a7030827-46cd-4e60-aa45-adac669d3b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90e3464-8f49-4f09-9afc-40d267284817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90e3464-8f49-4f09-9afc-40d267284817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-267794689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c535e7f0-8fa9-4920-ba08-66b52cae20cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ce7b091183446995440f3c113e4b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:52:51Z,use_quota=True,user_id='30938091f7c24a80b7bded4d86928f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e21f37-1841-4a28-bb80-565876747f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e21f37-1841-4a28-bb80-565876747f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f0cef2-443c-4a8e-ad13-fc2249d3c904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f0cef2-443c-4a8e-ad13-fc2249d3c904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c535e7f0-8fa9-4920-ba08-66b52cae20cd', 'volume_name': 'volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3366945-7b63-4372-b4e7-f26196e099df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3366945-7b63-4372-b4e7-f26196e099df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6554dbf0-164c-4a25-8e23-bd7981ec77ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Volume c535e7f0-8fa9-4920-ba08-66b52cae20cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd', 'volume_size': 1}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-267794689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c535e7f0-8fa9-4920-ba08-66b52cae20cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ce7b091183446995440f3c113e4b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:52:51Z,use_quota=True,user_id='30938091f7c24a80b7bded4d86928f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Creating volume c535e7f0-8fa9-4920-ba08-66b52cae20cd {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:52:50 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:52:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:50 devstack sudo[91439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd 1073741824
Jul 14 17:52:50 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:51 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd 1073741824" returned: 0 in 0.533s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:51 devstack sudo[91445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd
Jul 14 17:52:51 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:51 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd" returned: 0 in 0.543s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:52:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6554dbf0-164c-4a25-8e23-bd7981ec77ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a42bfd3-77f4-467b-8351-ecfaf9316f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:52:51 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Volume volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd (c535e7f0-8fa9-4920-ba08-66b52cae20cd): created successfully
Jul 14 17:52:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a42bfd3-77f4-467b-8351-ecfaf9316f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:52:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Flow 'volume_create_manager' (a7030827-46cd-4e60-aa45-adac669d3b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:52:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-53c996ef-a57f-49db-94e9-31690bb4a03d tempest-VolumesTransfersV355Test-477052652 None] Created volume successfully.
Jul 14 17:52:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Acquiring lock "cinder-c535e7f0-8fa9-4920-ba08-66b52cae20cd-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:52:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Lock "cinder-c535e7f0-8fa9-4920-ba08-66b52cae20cd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:52:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Acquiring lock "cinder-quobyte-c535e7f0-8fa9-4920-ba08-66b52cae20cd" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:52:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Lock "cinder-quobyte-c535e7f0-8fa9-4920-ba08-66b52cae20cd" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:52:53 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cc5945-ffbb-4418-a0b6-771d102b5d40]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:52:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:53 devstack sudo[91457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd
Jul 14 17:52:53 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:53 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd" returned: 0 in 0.402s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:53 devstack sudo[91462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd
Jul 14 17:52:53 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:54 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c535e7f0-8fa9-4920-ba08-66b52cae20cd" returned: 0 in 0.315s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Lock "cinder-quobyte-c535e7f0-8fa9-4920-ba08-66b52cae20cd" released by "delete_volume" :: held 0.761s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:52:54 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Created reservations ['0a57f379-38cd-407c-821d-8956582d2eea', 'ea251b3e-0b5e-4216-b1e4-9d8dd5fa1b83', 'f89384ba-db98-4be0-9baa-895e8d447c36', 'a7dad325-90b5-4e88-8e1a-41af3562aebd'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:52:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:52:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:52:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:52:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:52:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:52:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:52:54 devstack sudo[91465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:52:54 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:52:54 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root
Jul 14 17:52:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.266s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:52:54 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:52:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Deleted volume successfully.
Jul 14 17:52:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2d9c779-5a1c-4e0a-a8a6-f32a80d523ac tempest-VolumesTransfersV355Test-1000967551 None] Lock "cinder-c535e7f0-8fa9-4920-ba08-66b52cae20cd-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Flow 'volume_create_manager' (a641902c-718e-499a-ba35-e81c4c219160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93c28f7-2ee3-4b9f-8bef-d6d763a01221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93c28f7-2ee3-4b9f-8bef-d6d763a01221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2002847685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70b82b7-4134-4622-a211-ad81bce91663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f49ead762143c8b04d804420f4eb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:53:01Z,use_quota=True,user_id='284b22e8fd154e8f91e32536118bd7c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0938cda-d311-43f8-92f5-14bef09d02a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0938cda-d311-43f8-92f5-14bef09d02a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb6bcf8-1466-4837-a4e6-0f30bef1ccfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb6bcf8-1466-4837-a4e6-0f30bef1ccfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a70b82b7-4134-4622-a211-ad81bce91663', 'volume_name': 'volume-a70b82b7-4134-4622-a211-ad81bce91663', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b1ac62-11e8-4e73-9fdd-eb01da9ceca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b1ac62-11e8-4e73-9fdd-eb01da9ceca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd42668-7680-46cd-98e8-0013626b9e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Volume a70b82b7-4134-4622-a211-ad81bce91663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a70b82b7-4134-4622-a211-ad81bce91663', 'volume_size': 1}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2002847685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70b82b7-4134-4622-a211-ad81bce91663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f49ead762143c8b04d804420f4eb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:53:01Z,use_quota=True,user_id='284b22e8fd154e8f91e32536118bd7c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Creating volume a70b82b7-4134-4622-a211-ad81bce91663 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:53:01 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:53:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:01 devstack sudo[91487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663 1073741824
Jul 14 17:53:01 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:02 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663 1073741824" returned: 0 in 0.763s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:02 devstack sudo[91496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663
Jul 14 17:53:02 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:02 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd42668-7680-46cd-98e8-0013626b9e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a70b82b7-4134-4622-a211-ad81bce91663', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36215c50-9b67-4f29-8a49-05f34ff43579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Volume volume-a70b82b7-4134-4622-a211-ad81bce91663 (a70b82b7-4134-4622-a211-ad81bce91663): created successfully
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36215c50-9b67-4f29-8a49-05f34ff43579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Flow 'volume_create_manager' (a641902c-718e-499a-ba35-e81c4c219160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Flow 'volume_create_manager' (8747c85c-5f89-4bf1-903c-5de9292e4f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cded54dc-74ed-4031-bbce-8c3e51317976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5c67a8a6-aa4f-4a92-a3d7-1abcf18dafe6 tempest-ServerActionsTestOtherA-126595152 None] Created volume successfully.
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cded54dc-74ed-4031-bbce-8c3e51317976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1438660383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6ebe1e-69a2-4c94-bfc5-898f904f9641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951acda70eff4bd8bfe2056148a22a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:53:02Z,use_quota=True,user_id='bd6a8776623343e4902fad2c68eabfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8938c041-cb3b-433e-b9c8-239d882b0bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8938c041-cb3b-433e-b9c8-239d882b0bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826107ec-4b83-46b8-aaa1-d4f4ecaba7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:02 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 17:53:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826107ec-4b83-46b8-aaa1-d4f4ecaba7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d6ebe1e-69a2-4c94-bfc5-898f904f9641', 'volume_name': 'volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641', 'volume_size': 1, 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b35106125384bcf9ba800ba74e8254d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'created_at': datetime.datetime(2026, 7, 14, 15, 43, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 43, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3eef7b-9b54-4ea1-a240-6be757f56381/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca2626f0>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fab1302-30f1-4038-95ef-5c38b1310b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fab1302-30f1-4038-95ef-5c38b1310b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db63f007-bd13-4dcd-b489-de34687fb6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Volume 0d6ebe1e-69a2-4c94-bfc5-898f904f9641: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641', 'volume_size': 1, 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b35106125384bcf9ba800ba74e8254d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'created_at': datetime.datetime(2026, 7, 14, 15, 43, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 43, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3eef7b-9b54-4ea1-a240-6be757f56381/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca2626f0>}
Jul 14 17:53:03 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Trying to clone 0d6ebe1e-69a2-4c94-bfc5-898f904f9641 from image af3eef7b-9b54-4ea1-a240-6be757f56381 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 17:53:03 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 17:53:03 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Image download 20.69 MB at 20.69 MB/s
Jul 14 17:53:03 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b687f341-9645-4379-97de-42bf22adbee6]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:03 devstack sudo[91520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD
Jul 14 17:53:03 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:03 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:03 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Temporary image af3eef7b-9b54-4ea1-a240-6be757f56381 is fetched for user bd6a8776623343e4902fad2c68eabfc5. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 17:53:03 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ebe980-98a1-493a-b007-8247170379cd]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:04 devstack sudo[91525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD
Jul 14 17:53:04 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:04 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1438660383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6ebe1e-69a2-4c94-bfc5-898f904f9641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951acda70eff4bd8bfe2056148a22a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:53:02Z,use_quota=True,user_id='bd6a8776623343e4902fad2c68eabfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:53:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Creating volume 0d6ebe1e-69a2-4c94-bfc5-898f904f9641 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:53:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:53:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:53:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:53:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:53:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:04 devstack sudo[91530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 1073741824
Jul 14 17:53:04 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:04 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 1073741824" returned: 0 in 0.687s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:05 devstack sudo[91538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641
Jul 14 17:53:05 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:05 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641" returned: 0 in 0.328s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:53:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:05 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Attempting download of af3eef7b-9b54-4ea1-a240-6be757f56381 ((None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}])) to volume 0d6ebe1e-69a2-4c94-bfc5-898f904f9641. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 17:53:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef5eafb-1904-4faa-9eab-9fd6befdcee8]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_n5fc_f1d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:05 devstack sudo[91544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_n5fc_f1d
Jul 14 17:53:05 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:05 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_n5fc_f1d" returned: 0 in 0.428s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_n5fc_f1d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:06 devstack sudo[91548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_n5fc_f1d
Jul 14 17:53:06 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:06 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_n5fc_f1d" returned: 1 in 0.405s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_n5fc_f1d' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:53:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0219d47-935d-4822-81e2-0d7b6bd3b34e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:06 devstack sudo[91556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD
Jul 14 17:53:06 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:06 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:06 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] af3eef7b-9b54-4ea1-a240-6be757f56381 was qcow2, converting to raw {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 17:53:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:06 devstack sudo[91572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641
Jul 14 17:53:06 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:09 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641" returned: 0 in 2.378s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:09 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_8p2ozow2devstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 17:53:09 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Converted 112.00 MB image at 47.08 MB/s
Jul 14 17:53:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:09 devstack sudo[91593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 1G
Jul 14 17:53:09 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:09 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 1G" returned: 0 in 0.789s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b1e41d-a808-45b7-bd5a-e1adb5d00cfb]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:10 devstack sudo[91628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641
Jul 14 17:53:10 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:10 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641" returned: 0 in 0.540s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:10 devstack sudo[91658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641
Jul 14 17:53:10 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:11 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641" returned: 1 in 0.378s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:53:11 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Downloaded image af3eef7b-9b54-4ea1-a240-6be757f56381 ((None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}])) to volume 0d6ebe1e-69a2-4c94-bfc5-898f904f9641 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 17:53:11 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Temporary image af3eef7b-9b54-4ea1-a240-6be757f56381 for user bd6a8776623343e4902fad2c68eabfc5 is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 17:53:11 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Marking volume 0d6ebe1e-69a2-4c94-bfc5-898f904f9641 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 17:53:11 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Copying metadata from image af3eef7b-9b54-4ea1-a240-6be757f56381 to 0d6ebe1e-69a2-4c94-bfc5-898f904f9641. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 17:53:11 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Creating volume glance metadata for volume 0d6ebe1e-69a2-4c94-bfc5-898f904f9641 backed by image af3eef7b-9b54-4ea1-a240-6be757f56381 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 17:53:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db63f007-bd13-4dcd-b489-de34687fb6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641', 'volume_size': 1, 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b35106125384bcf9ba800ba74e8254d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'created_at': datetime.datetime(2026, 7, 14, 15, 43, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 43, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3eef7b-9b54-4ea1-a240-6be757f56381/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca2626f0>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e0b637-8ad2-4061-910b-dd084bc2d5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:11 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Volume volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 (0d6ebe1e-69a2-4c94-bfc5-898f904f9641): created successfully
Jul 14 17:53:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e0b637-8ad2-4061-910b-dd084bc2d5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Flow 'volume_create_manager' (8747c85c-5f89-4bf1-903c-5de9292e4f43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:53:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-05bf4290-f6d5-4e71-a61f-6de6374864e7 tempest-VolumesExtendTest-1892214202 None] Created volume successfully.
Jul 14 17:53:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d28e9755-f7c1-4b76-9d9a-57e6464ee403 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d28e9755-f7c1-4b76-9d9a-57e6464ee403 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b73065-5044-4609-8a32-5e4a0f121520]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d28e9755-f7c1-4b76-9d9a-57e6464ee403 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:12 devstack sudo[91671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641
Jul 14 17:53:12 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:13 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d28e9755-f7c1-4b76-9d9a-57e6464ee403 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641" returned: 0 in 0.710s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d28e9755-f7c1-4b76-9d9a-57e6464ee403 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:13 devstack sudo[91695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641
Jul 14 17:53:13 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:14 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d28e9755-f7c1-4b76-9d9a-57e6464ee403 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641" returned: 1 in 0.771s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d28e9755-f7c1-4b76-9d9a-57e6464ee403 tempest-VolumesExtendTest-1892214202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d28e9755-f7c1-4b76-9d9a-57e6464ee403 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 2G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d28e9755-f7c1-4b76-9d9a-57e6464ee403 tempest-VolumesExtendTest-1892214202 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 2G" returned: 0 in 0.098s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d28e9755-f7c1-4b76-9d9a-57e6464ee403 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.687s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d28e9755-f7c1-4b76-9d9a-57e6464ee403 tempest-VolumesExtendTest-1892214202 None] Extend volume completed successfully.
Jul 14 17:53:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "cinder-0d6ebe1e-69a2-4c94-bfc5-898f904f9641-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:53:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-0d6ebe1e-69a2-4c94-bfc5-898f904f9641-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:53:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "cinder-quobyte-0d6ebe1e-69a2-4c94-bfc5-898f904f9641" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:53:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-quobyte-0d6ebe1e-69a2-4c94-bfc5-898f904f9641" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:53:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc44d249-bdf8-4bac-8106-69720becaa6b]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:15 devstack sudo[91714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641
Jul 14 17:53:15 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:16 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641" returned: 0 in 1.386s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:17 devstack sudo[91773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641
Jul 14 17:53:17 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:17 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641" returned: 1 in 0.975s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:53:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:17 devstack sudo[91793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641
Jul 14 17:53:17 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:18 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0d6ebe1e-69a2-4c94-bfc5-898f904f9641" returned: 0 in 0.390s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-quobyte-0d6ebe1e-69a2-4c94-bfc5-898f904f9641" released by "delete_volume" :: held 2.876s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:53:18 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Created reservations ['e7426a9a-0926-4396-b384-5dd462aa552a', '2d70b625-62e4-4d74-bc00-5947432bee9c', '3a332377-aadb-4d09-a1bb-bcf25ab509c5', '72931225-8fbd-45aa-a6ad-c6f361f318a8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:53:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:53:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:53:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:18 devstack sudo[91800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:53:18 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:19 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.788s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:19 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:53:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Deleted volume successfully.
Jul 14 17:53:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-52fca875-c41e-411e-9523-e7889f488940 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-0d6ebe1e-69a2-4c94-bfc5-898f904f9641-delete_volume" released by "delete_volume" :: held 4.118s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Flow 'volume_create_manager' (9c3e3223-e591-473f-a41c-75f22864c5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b125c88-88c5-4090-ab03-ec752ed1cc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b125c88-88c5-4090-ab03-ec752ed1cc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1861559097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56ea50d-0a7f-450d-80d5-d9788ebf361a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951acda70eff4bd8bfe2056148a22a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:53:20Z,use_quota=True,user_id='bd6a8776623343e4902fad2c68eabfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b57b93-9040-4f5e-9417-4054aab7cb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b57b93-9040-4f5e-9417-4054aab7cb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e7adce-2101-4340-9356-28686c8c633c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e7adce-2101-4340-9356-28686c8c633c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e56ea50d-0a7f-450d-80d5-d9788ebf361a', 'volume_name': 'volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697b7010-1f99-49be-95fd-ff20ee303bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697b7010-1f99-49be-95fd-ff20ee303bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd00344-cee9-4f56-a1e7-c107e3e49c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:20 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Volume e56ea50d-0a7f-450d-80d5-d9788ebf361a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a', 'volume_size': 1}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1861559097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56ea50d-0a7f-450d-80d5-d9788ebf361a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951acda70eff4bd8bfe2056148a22a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:53:20Z,use_quota=True,user_id='bd6a8776623343e4902fad2c68eabfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Creating volume e56ea50d-0a7f-450d-80d5-d9788ebf361a {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:53:20 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:20 devstack sudo[91805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a 1073741824
Jul 14 17:53:20 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:20 devstack sudo[91807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:53:20 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-c6df864d-873d-48f0-a04c-7a705182dc94 req-c67cd170-afbc-427d-b07b-a898770e7e11 tempest-AttachVolumeNegativeTest-313902525 None] Terminate volume connection completed successfully.
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-c6df864d-873d-48f0-a04c-7a705182dc94 req-c67cd170-afbc-427d-b07b-a898770e7e11 tempest-AttachVolumeNegativeTest-313902525 None] Deleting attachment ff455a71-bf53-45db-9187-e7b7aca712bd. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:53:21 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:21 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.478s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a 1073741824" returned: 0 in 0.857s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:21 devstack sudo[91817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a
Jul 14 17:53:21 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:21 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a" returned: 0 in 0.455s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd00344-cee9-4f56-a1e7-c107e3e49c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8281dcd9-a610-47e6-99a8-d692067835cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Volume volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a (e56ea50d-0a7f-450d-80d5-d9788ebf361a): created successfully
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8281dcd9-a610-47e6-99a8-d692067835cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Flow 'volume_create_manager' (9c3e3223-e591-473f-a41c-75f22864c5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:53:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ac9b9e3c-1c63-46f5-ad0a-052168d99763 tempest-VolumesExtendTest-1892214202 None] Created volume successfully.
Jul 14 17:53:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] Creating offline snapshot 6e87223a-b8dd-4dfb-9729-cfda16bc29ea of volume e56ea50d-0a7f-450d-80d5-d9788ebf361a {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:53:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[79107b2a-736a-4528-83c0-9bcedee81dc2]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:23 devstack sudo[91843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a
Jul 14 17:53:23 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:24 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a" returned: 0 in 1.104s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:24 devstack sudo[91850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea 1G
Jul 14 17:53:24 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:25 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea 1G" returned: 0 in 0.932s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:25 devstack sudo[91885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea
Jul 14 17:53:25 devstack sudo[91885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:25 devstack sudo[91885]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea" returned: 0 in 0.512s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:25 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea is being set with open permissions: ugo+rw
Jul 14 17:53:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:25 devstack sudo[91902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea
Jul 14 17:53:25 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:26 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea" returned: 0 in 0.460s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:26 devstack sudo[91912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.info
Jul 14 17:53:26 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:26 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.info" returned: 0 in 0.465s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:26 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.info is being set with open permissions: ugo+rw
Jul 14 17:53:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:26 devstack sudo[91916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.info
Jul 14 17:53:26 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:27 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.info" returned: 0 in 0.321s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.998s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6ceb115e-4043-4915-8eb7-ddeecaeceefa tempest-VolumesExtendTest-1892214202 None] Create snapshot completed successfully
Jul 14 17:53:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27fc2f9c-9b7e-4b28-beaa-3166ed3917ef tempest-VolumesExtendTest-1892214202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27fc2f9c-9b7e-4b28-beaa-3166ed3917ef tempest-VolumesExtendTest-1892214202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce7cd8e-0f0a-4d5c-9a04-37eddd389a8d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27fc2f9c-9b7e-4b28-beaa-3166ed3917ef tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:27 devstack sudo[91919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a
Jul 14 17:53:27 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:28 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27fc2f9c-9b7e-4b28-beaa-3166ed3917ef tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a" returned: 0 in 0.706s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27fc2f9c-9b7e-4b28-beaa-3166ed3917ef tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea 2G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27fc2f9c-9b7e-4b28-beaa-3166ed3917ef tempest-VolumesExtendTest-1892214202 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea 2G" returned: 0 in 0.160s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27fc2f9c-9b7e-4b28-beaa-3166ed3917ef tempest-VolumesExtendTest-1892214202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.914s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-27fc2f9c-9b7e-4b28-beaa-3166ed3917ef tempest-VolumesExtendTest-1892214202 None] Extend volume completed successfully.
Jul 14 17:53:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "cinder-6e87223a-b8dd-4dfb-9729-cfda16bc29ea-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:53:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-6e87223a-b8dd-4dfb-9729-cfda16bc29ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:53:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "cinder-quobyte-e56ea50d-0a7f-450d-80d5-d9788ebf361a" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:53:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-quobyte-e56ea50d-0a7f-450d-80d5-d9788ebf361a" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:53:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "cinder-quobyte-6e87223a-b8dd-4dfb-9729-cfda16bc29ea" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:53:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-quobyte-6e87223a-b8dd-4dfb-9729-cfda16bc29ea" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:53:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Deleting offline snapshot 6e87223a-b8dd-4dfb-9729-cfda16bc29ea of volume e56ea50d-0a7f-450d-80d5-d9788ebf361a {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:53:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] snapshot_file for this snap is: volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:53:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8a2849-ebbc-496a-a415-f9795b7f57c5]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:29 devstack sudo[91938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea
Jul 14 17:53:29 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:30 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea" returned: 0 in 1.045s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:53:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc50f963-34f6-4fe6-bfe9-466a56ccc826]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:30 devstack sudo[91975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a
Jul 14 17:53:30 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:31 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a" returned: 0 in 0.817s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:31 devstack sudo[92015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea
Jul 14 17:53:31 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:32 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea" returned: 0 in 1.024s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:32 devstack sudo[92023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea
Jul 14 17:53:32 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:32 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a.6e87223a-b8dd-4dfb-9729-cfda16bc29ea" returned: 0 in 0.692s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-quobyte-6e87223a-b8dd-4dfb-9729-cfda16bc29ea" released by "_delete_snapshot" :: held 3.820s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:53:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-quobyte-e56ea50d-0a7f-450d-80d5-d9788ebf361a" released by "delete_snapshot" :: held 3.863s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:53:33 devstack cinder-volume[87401]: WARNING cinder.quota [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:53:33 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Created reservations ['58e5ecf4-8a02-4db2-8103-26ddf17d07c2', '48b4d5cc-1f37-4919-b8a9-45231ec33c9e', '9ba2dad1-4b6a-4e7c-9510-38d56a251f69', '32a743a4-e21b-4578-96d5-83e537fc1eb2'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:53:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Delete snapshot completed successfully.
Jul 14 17:53:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08732413-3704-4dd8-a439-bc17978f5c24 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-6e87223a-b8dd-4dfb-9729-cfda16bc29ea-delete_snapshot" released by "delete_snapshot" :: held 4.131s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:53:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "cinder-e56ea50d-0a7f-450d-80d5-d9788ebf361a-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:53:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-e56ea50d-0a7f-450d-80d5-d9788ebf361a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:53:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "cinder-quobyte-e56ea50d-0a7f-450d-80d5-d9788ebf361a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:53:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-quobyte-e56ea50d-0a7f-450d-80d5-d9788ebf361a" acquired by "delete_volume" :: waited 0.043s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:53:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcea717f-2a74-4333-a670-066090d0ab08]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:34 devstack sudo[92061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a
Jul 14 17:53:34 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:34 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a" returned: 0 in 0.698s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:34 devstack sudo[92088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a
Jul 14 17:53:34 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:35 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e56ea50d-0a7f-450d-80d5-d9788ebf361a" returned: 0 in 0.431s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-quobyte-e56ea50d-0a7f-450d-80d5-d9788ebf361a" released by "delete_volume" :: held 1.307s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:53:35 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Created reservations ['4c2e7439-25bc-4f7c-b0a0-bf598030c899', '4b01f66e-2699-4e66-9e9f-7843be26e83b', 'f431c0c8-2b88-41cc-be7a-e8e20ddd4eb1', 'c2502a19-4395-4e37-932f-6e8fbd80faed'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:53:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:53:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:53:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:35 devstack sudo[92093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:53:35 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:35 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.299s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:35 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:53:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Deleted volume successfully.
Jul 14 17:53:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-99606c3b-61c6-4531-b8ac-5481e08aea42 tempest-VolumesExtendTest-1892214202 None] Lock "cinder-e56ea50d-0a7f-450d-80d5-d9788ebf361a-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Flow 'volume_create_manager' (0e6e0a23-b08d-4c1f-af2f-8f3e4f47bb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67dfecc0-4fdb-4d1a-a0e6-ed917a168fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67dfecc0-4fdb-4d1a-a0e6-ed917a168fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2000050219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b276eb-6d37-42e5-a1a0-69f9fa933998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb6a37f2c0a4a3784e7141955c42e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:53:38Z,use_quota=True,user_id='79bc43b021fc4112993a621d5dfb4e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077c6341-a0ef-44a3-a62a-c303e8de8f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077c6341-a0ef-44a3-a62a-c303e8de8f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0609b4c8-8615-4c42-b7d6-4c05663f1ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0609b4c8-8615-4c42-b7d6-4c05663f1ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b276eb-6d37-42e5-a1a0-69f9fa933998', 'volume_name': 'volume-18b276eb-6d37-42e5-a1a0-69f9fa933998', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f408ec-9d18-4545-b779-43d81bfde5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f408ec-9d18-4545-b779-43d81bfde5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030e97bf-b591-4d44-b6e5-0f6ddcfa71d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:38 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Volume 18b276eb-6d37-42e5-a1a0-69f9fa933998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b276eb-6d37-42e5-a1a0-69f9fa933998', 'volume_size': 1}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2000050219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b276eb-6d37-42e5-a1a0-69f9fa933998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb6a37f2c0a4a3784e7141955c42e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:53:38Z,use_quota=True,user_id='79bc43b021fc4112993a621d5dfb4e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Creating volume 18b276eb-6d37-42e5-a1a0-69f9fa933998 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:53:38 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:53:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-18b276eb-6d37-42e5-a1a0-69f9fa933998 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:38 devstack sudo[92117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-18b276eb-6d37-42e5-a1a0-69f9fa933998 1073741824
Jul 14 17:53:38 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:39 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-18b276eb-6d37-42e5-a1a0-69f9fa933998 1073741824" returned: 0 in 0.787s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-18b276eb-6d37-42e5-a1a0-69f9fa933998 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:39 devstack sudo[92133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-18b276eb-6d37-42e5-a1a0-69f9fa933998
Jul 14 17:53:39 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:39 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-18b276eb-6d37-42e5-a1a0-69f9fa933998" returned: 0 in 0.364s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030e97bf-b591-4d44-b6e5-0f6ddcfa71d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b276eb-6d37-42e5-a1a0-69f9fa933998', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f02614-a1b1-49fc-9510-db9449519ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:39 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Volume volume-18b276eb-6d37-42e5-a1a0-69f9fa933998 (18b276eb-6d37-42e5-a1a0-69f9fa933998): created successfully
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f02614-a1b1-49fc-9510-db9449519ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Flow 'volume_create_manager' (0e6e0a23-b08d-4c1f-af2f-8f3e4f47bb0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:53:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-edcea7e1-7445-4c88-8464-7908e4841355 tempest-ServersNegativeTestJSON-1505913192 None] Created volume successfully.
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-205f42c0-1439-4e62-9d66-446fd769f494 req-73fcc6bd-fb72-4e4e-a9b4-82e95acdd0f5 tempest-ServerActionsTestOtherA-126595152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-205f42c0-1439-4e62-9d66-446fd769f494 req-73fcc6bd-fb72-4e4e-a9b4-82e95acdd0f5 tempest-ServerActionsTestOtherA-126595152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[005f945f-0091-406e-ae23-db5b267b493c]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-205f42c0-1439-4e62-9d66-446fd769f494 req-73fcc6bd-fb72-4e4e-a9b4-82e95acdd0f5 tempest-ServerActionsTestOtherA-126595152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:39 devstack sudo[92145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663
Jul 14 17:53:39 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:40 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-205f42c0-1439-4e62-9d66-446fd769f494 req-73fcc6bd-fb72-4e4e-a9b4-82e95acdd0f5 tempest-ServerActionsTestOtherA-126595152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663" returned: 0 in 0.519s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-205f42c0-1439-4e62-9d66-446fd769f494 req-73fcc6bd-fb72-4e4e-a9b4-82e95acdd0f5 tempest-ServerActionsTestOtherA-126595152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.540s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:40 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=67,cinder:SELECT=58,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:53:40 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=53,cinder:INSERT=20,cinder:UPDATE=61,cinder:DELETE=4 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:53:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-205f42c0-1439-4e62-9d66-446fd769f494 req-73fcc6bd-fb72-4e4e-a9b4-82e95acdd0f5 tempest-ServerActionsTestOtherA-126595152 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-a70b82b7-4134-4622-a211-ad81bce91663', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2e77ab3-c8f7-4a7d-852a-f4b9733ae5ed', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:53:40 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-205f42c0-1439-4e62-9d66-446fd769f494 req-73fcc6bd-fb72-4e4e-a9b4-82e95acdd0f5 tempest-ServerActionsTestOtherA-126595152 None] attachment_update completed successfully.
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Flow 'volume_create_manager' (d71a3abc-e29d-4d30-a90b-eeb91291487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4986a56d-b6a7-4904-9f61-c0f7c550a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4986a56d-b6a7-4904-9f61-c0f7c550a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2010757420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0589f969-dffc-4596-91be-dae46163b4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb6a37f2c0a4a3784e7141955c42e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:53:44Z,use_quota=True,user_id='79bc43b021fc4112993a621d5dfb4e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1a6b2d-51bc-4fea-89a1-6bffb7a16441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1a6b2d-51bc-4fea-89a1-6bffb7a16441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133c7cba-e824-4686-b8e1-95c7f96c9975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133c7cba-e824-4686-b8e1-95c7f96c9975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0589f969-dffc-4596-91be-dae46163b4ee', 'volume_name': 'volume-0589f969-dffc-4596-91be-dae46163b4ee', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8855e885-c2a8-457a-8654-bfac6965ba3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8855e885-c2a8-457a-8654-bfac6965ba3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67dd419-b452-4398-be4b-6c622f57d398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:44 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Volume 0589f969-dffc-4596-91be-dae46163b4ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0589f969-dffc-4596-91be-dae46163b4ee', 'volume_size': 1}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2010757420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0589f969-dffc-4596-91be-dae46163b4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bb6a37f2c0a4a3784e7141955c42e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:53:44Z,use_quota=True,user_id='79bc43b021fc4112993a621d5dfb4e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Creating volume 0589f969-dffc-4596-91be-dae46163b4ee {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:53:44 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:53:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0589f969-dffc-4596-91be-dae46163b4ee 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:44 devstack sudo[92625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0589f969-dffc-4596-91be-dae46163b4ee 1073741824
Jul 14 17:53:44 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:45 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0589f969-dffc-4596-91be-dae46163b4ee 1073741824" returned: 0 in 0.880s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0589f969-dffc-4596-91be-dae46163b4ee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:45 devstack sudo[92634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0589f969-dffc-4596-91be-dae46163b4ee
Jul 14 17:53:45 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:45 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0589f969-dffc-4596-91be-dae46163b4ee" returned: 0 in 0.437s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:53:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67dd419-b452-4398-be4b-6c622f57d398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0589f969-dffc-4596-91be-dae46163b4ee', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13406f18-0055-47e9-a376-bf496950ce7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:45 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Volume volume-0589f969-dffc-4596-91be-dae46163b4ee (0589f969-dffc-4596-91be-dae46163b4ee): created successfully
Jul 14 17:53:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13406f18-0055-47e9-a376-bf496950ce7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Flow 'volume_create_manager' (d71a3abc-e29d-4d30-a90b-eeb91291487b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:53:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ede664a3-9bfe-46f3-af33-00d71dcd1f81 tempest-ServersNegativeTestJSON-1505913192 None] Created volume successfully.
Jul 14 17:53:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-bd5ffcd2-e86f-4d5a-968a-682a58c0858f req-6bc3b401-8390-422c-bb7c-93fa81cc2aae tempest-ServerActionsTestOtherA-126595152 None] Terminate volume connection completed successfully.
Jul 14 17:53:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-bd5ffcd2-e86f-4d5a-968a-682a58c0858f req-6bc3b401-8390-422c-bb7c-93fa81cc2aae tempest-ServerActionsTestOtherA-126595152 None] Deleting attachment c2e77ab3-c8f7-4a7d-852a-f4b9733ae5ed. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:53:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-bd5ffcd2-e86f-4d5a-968a-682a58c0858f req-b616e6f2-a21a-4bbf-a613-f1a76b0b0235 tempest-ServerActionsTestOtherA-126595152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-bd5ffcd2-e86f-4d5a-968a-682a58c0858f req-b616e6f2-a21a-4bbf-a613-f1a76b0b0235 tempest-ServerActionsTestOtherA-126595152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:47 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a635754-1507-4c83-9ffe-7da370160474]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-bd5ffcd2-e86f-4d5a-968a-682a58c0858f req-b616e6f2-a21a-4bbf-a613-f1a76b0b0235 tempest-ServerActionsTestOtherA-126595152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:48 devstack sudo[92697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663
Jul 14 17:53:48 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:48 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-bd5ffcd2-e86f-4d5a-968a-682a58c0858f req-b616e6f2-a21a-4bbf-a613-f1a76b0b0235 tempest-ServerActionsTestOtherA-126595152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663" returned: 0 in 0.467s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-bd5ffcd2-e86f-4d5a-968a-682a58c0858f req-b616e6f2-a21a-4bbf-a613-f1a76b0b0235 tempest-ServerActionsTestOtherA-126595152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.511s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-bd5ffcd2-e86f-4d5a-968a-682a58c0858f req-b616e6f2-a21a-4bbf-a613-f1a76b0b0235 tempest-ServerActionsTestOtherA-126595152 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-a70b82b7-4134-4622-a211-ad81bce91663', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de4d1a4e-3521-40e0-ba44-f43320b1598b', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:53:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-bd5ffcd2-e86f-4d5a-968a-682a58c0858f req-b616e6f2-a21a-4bbf-a613-f1a76b0b0235 tempest-ServerActionsTestOtherA-126595152 None] attachment_update completed successfully.
Jul 14 17:53:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Acquiring lock "cinder-0589f969-dffc-4596-91be-dae46163b4ee-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:53:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Lock "cinder-0589f969-dffc-4596-91be-dae46163b4ee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:53:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Acquiring lock "cinder-quobyte-0589f969-dffc-4596-91be-dae46163b4ee" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:53:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Lock "cinder-quobyte-0589f969-dffc-4596-91be-dae46163b4ee" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:53:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[41867cb1-db1a-4738-be53-a6b9956a8d69]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0589f969-dffc-4596-91be-dae46163b4ee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:50 devstack sudo[92724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0589f969-dffc-4596-91be-dae46163b4ee
Jul 14 17:53:50 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:50 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0589f969-dffc-4596-91be-dae46163b4ee" returned: 0 in 0.813s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0589f969-dffc-4596-91be-dae46163b4ee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:50 devstack sudo[93095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0589f969-dffc-4596-91be-dae46163b4ee
Jul 14 17:53:50 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:51 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0589f969-dffc-4596-91be-dae46163b4ee" returned: 0 in 0.581s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Lock "cinder-quobyte-0589f969-dffc-4596-91be-dae46163b4ee" released by "delete_volume" :: held 1.468s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:53:51 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Created reservations ['06f2a56d-0d53-4017-8cf0-a205451108f1', 'b32223e1-b9ce-406a-8fb1-4fcbfbb1f4b3', 'd86ce43c-6caf-492f-b1e0-70e56904b885', '95d6d5ce-7102-44c6-9ca3-73a51ca207cb'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:53:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:53:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:53:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:51 devstack sudo[93149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:53:51 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:52 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.390s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:52 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:53:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Deleted volume successfully.
Jul 14 17:53:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-34e73314-f10e-422c-b2ff-22df4e9ec397 tempest-ServersNegativeTestJSON-1505913192 None] Lock "cinder-0589f969-dffc-4596-91be-dae46163b4ee-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:53:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Acquiring lock "cinder-18b276eb-6d37-42e5-a1a0-69f9fa933998-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:53:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Lock "cinder-18b276eb-6d37-42e5-a1a0-69f9fa933998-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:53:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Acquiring lock "cinder-quobyte-18b276eb-6d37-42e5-a1a0-69f9fa933998" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:53:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Lock "cinder-quobyte-18b276eb-6d37-42e5-a1a0-69f9fa933998" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:53:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ceaf82f-33c8-4b25-ba5c-559b3b561f3f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:53:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-18b276eb-6d37-42e5-a1a0-69f9fa933998 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:52 devstack sudo[93152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-18b276eb-6d37-42e5-a1a0-69f9fa933998
Jul 14 17:53:52 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:53 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-18b276eb-6d37-42e5-a1a0-69f9fa933998" returned: 0 in 1.035s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-18b276eb-6d37-42e5-a1a0-69f9fa933998 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:53 devstack sudo[93165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-18b276eb-6d37-42e5-a1a0-69f9fa933998
Jul 14 17:53:53 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:54 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-18b276eb-6d37-42e5-a1a0-69f9fa933998" returned: 0 in 0.555s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Lock "cinder-quobyte-18b276eb-6d37-42e5-a1a0-69f9fa933998" released by "delete_volume" :: held 1.668s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:53:54 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Created reservations ['44925e6f-fc89-4acd-90af-031c6b579387', 'd3c6a557-0114-4181-9f9d-cef076509e31', '1dab0e5f-3753-453c-b0a5-658932f6649d', '8f0df111-8ec6-4970-927b-1220907bf7fc'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:53:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:53:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:53:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:54 devstack sudo[93168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:53:54 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:55 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.578s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:55 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:53:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Deleted volume successfully.
Jul 14 17:53:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cd1f81ac-2cf9-4275-8728-b9585227395f tempest-ServersNegativeTestJSON-1505913192 None] Lock "cinder-18b276eb-6d37-42e5-a1a0-69f9fa933998-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Flow 'volume_create_manager' (f662c0fc-dc68-426a-a8d6-9b6911f7162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f879c2-309a-4380-87e0-4c08fee12748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f879c2-309a-4380-87e0-4c08fee12748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-300156072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e05901-a34b-46db-bfcb-14c18f48fbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d7c498dc1c4882a8a8d07444a0e6ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:53:59Z,use_quota=True,user_id='8edf8f2897634d2f9073116d244c8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3112724-c5c1-4488-9c2a-cf5bd78bfbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3112724-c5c1-4488-9c2a-cf5bd78bfbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b273c148-2f07-4f16-b2c7-dc9fc86a86a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b273c148-2f07-4f16-b2c7-dc9fc86a86a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31e05901-a34b-46db-bfcb-14c18f48fbce', 'volume_name': 'volume-31e05901-a34b-46db-bfcb-14c18f48fbce', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd68e600-b7c3-4b59-933c-12993257227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd68e600-b7c3-4b59-933c-12993257227c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad28358-d392-49f8-81d4-b0400d9f49cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:53:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Volume 31e05901-a34b-46db-bfcb-14c18f48fbce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31e05901-a34b-46db-bfcb-14c18f48fbce', 'volume_size': 1}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-300156072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e05901-a34b-46db-bfcb-14c18f48fbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d7c498dc1c4882a8a8d07444a0e6ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:53:59Z,use_quota=True,user_id='8edf8f2897634d2f9073116d244c8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Creating volume 31e05901-a34b-46db-bfcb-14c18f48fbce {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:53:59 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:59 devstack sudo[93237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce 1073741824
Jul 14 17:53:59 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:53:59 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce 1073741824" returned: 0 in 0.492s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:53:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:53:59 devstack sudo[93244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce
Jul 14 17:53:59 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:00 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:54:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad28358-d392-49f8-81d4-b0400d9f49cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e05901-a34b-46db-bfcb-14c18f48fbce', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da043f6-6f5e-4235-8696-6585ea4f1e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Volume volume-31e05901-a34b-46db-bfcb-14c18f48fbce (31e05901-a34b-46db-bfcb-14c18f48fbce): created successfully
Jul 14 17:54:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da043f6-6f5e-4235-8696-6585ea4f1e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Flow 'volume_create_manager' (f662c0fc-dc68-426a-a8d6-9b6911f7162e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-238d4adb-0871-4845-9371-953c332ffd5c tempest-VolumesSnapshotTestJSON-289733435 None] Created volume successfully.
Jul 14 17:54:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] Creating offline snapshot b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3 of volume 31e05901-a34b-46db-bfcb-14c18f48fbce {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:54:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c44b60b-605e-4542-9837-683b485158ec]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:01 devstack sudo[93247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce
Jul 14 17:54:01 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:01 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce" returned: 0 in 0.441s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:01 devstack sudo[93253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3 1G
Jul 14 17:54:01 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:02 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3 1G" returned: 0 in 0.458s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31e05901-a34b-46db-bfcb-14c18f48fbce -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:02 devstack sudo[93260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31e05901-a34b-46db-bfcb-14c18f48fbce -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3
Jul 14 17:54:02 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:02 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31e05901-a34b-46db-bfcb-14c18f48fbce -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:02 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3 is being set with open permissions: ugo+rw
Jul 14 17:54:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:02 devstack sudo[93265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3
Jul 14 17:54:02 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:02 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3" returned: 0 in 0.276s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:03 devstack sudo[93268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.info
Jul 14 17:54:03 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:03 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.info" returned: 0 in 0.303s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:03 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.info is being set with open permissions: ugo+rw
Jul 14 17:54:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:03 devstack sudo[93271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.info
Jul 14 17:54:03 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:03 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.info" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0bc16361-aca8-4f87-a2aa-848ee11b092a tempest-VolumesSnapshotTestJSON-289733435 None] Create snapshot completed successfully
Jul 14 17:54:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-31e05901-a34b-46db-bfcb-14c18f48fbce" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-31e05901-a34b-46db-bfcb-14c18f48fbce" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Deleting offline snapshot b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3 of volume 31e05901-a34b-46db-bfcb-14c18f48fbce {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:54:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] snapshot_file for this snap is: volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:54:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7bc9be-7daf-464b-ba3f-92430af5af89]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:05 devstack sudo[93275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3
Jul 14 17:54:05 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:05 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3" returned: 0 in 0.501s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31e05901-a34b-46db-bfcb-14c18f48fbce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:54:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f5b1ac-e18b-400d-bddc-8c4932d41d96]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:05 devstack sudo[93281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce
Jul 14 17:54:05 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:06 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce" returned: 0 in 0.538s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:06 devstack sudo[93287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3
Jul 14 17:54:06 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:06 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:06 devstack sudo[93293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3
Jul 14 17:54:06 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:06 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce.b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3" released by "_delete_snapshot" :: held 1.934s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-31e05901-a34b-46db-bfcb-14c18f48fbce" released by "delete_snapshot" :: held 1.963s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Created reservations ['55b1d1be-3767-4e41-a032-4100b92d44f9', '7416bf11-937f-4f51-909c-9e5bea2a7321', '8a0fae42-80fe-4006-b1f9-ecb6fefe6262', '8b136651-2183-458f-ad7d-af1debaa9682'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:54:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Delete snapshot completed successfully.
Jul 14 17:54:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5c053663-c170-44b7-be7c-df31f49e2415 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-b91243ca-b7fa-4d76-a5ba-dbda52dc8ef3-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Flow 'volume_create_manager' (b0bfb520-c40a-423a-b0b7-3ed71edcfbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462bf61b-c5bb-444f-b7ce-c63c9e551389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462bf61b-c5bb-444f-b7ce-c63c9e551389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1145495661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02c0cc2-7092-44b1-90e9-fa61084c2b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d7c498dc1c4882a8a8d07444a0e6ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:54:09Z,use_quota=True,user_id='8edf8f2897634d2f9073116d244c8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (720e8a9e-6cfa-43bf-a62d-e0815a74673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (720e8a9e-6cfa-43bf-a62d-e0815a74673b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0593a17-aced-4032-8c25-cb4c8599c762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0593a17-aced-4032-8c25-cb4c8599c762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02c0cc2-7092-44b1-90e9-fa61084c2b94', 'volume_name': 'volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d91cac-cb61-4dbc-bc9f-58abf383eb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d91cac-cb61-4dbc-bc9f-58abf383eb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef446907-4f10-4d2a-8b1b-be0caeef7fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:08 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Volume f02c0cc2-7092-44b1-90e9-fa61084c2b94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94', 'volume_size': 1}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1145495661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02c0cc2-7092-44b1-90e9-fa61084c2b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d7c498dc1c4882a8a8d07444a0e6ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:54:09Z,use_quota=True,user_id='8edf8f2897634d2f9073116d244c8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Creating volume f02c0cc2-7092-44b1-90e9-fa61084c2b94 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:54:08 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:54:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:08 devstack sudo[93327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 1073741824
Jul 14 17:54:08 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Flow 'volume_create_manager' (9986b4df-d7f6-43af-90f4-8fc4281e2408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad77341-218b-4bc6-a9ea-5bdb8828af13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad77341-218b-4bc6-a9ea-5bdb8828af13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-592968682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a47cca-cf03-4ac4-b642-f256db891961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f392491ab1a420387685deb09b63019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:54:09Z,use_quota=True,user_id='ce44e00e10a041158f9654b04abedc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79284d56-26eb-4e29-adc9-08c70ab50fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79284d56-26eb-4e29-adc9-08c70ab50fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc5181f-3029-4904-a5d4-52817951a1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc5181f-3029-4904-a5d4-52817951a1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a47cca-cf03-4ac4-b642-f256db891961', 'volume_name': 'volume-61a47cca-cf03-4ac4-b642-f256db891961', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2c1337-b9d2-49d7-9331-eb8beaffc182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2c1337-b9d2-49d7-9331-eb8beaffc182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:09 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c2a1b1-81b0-4924-a8b8-0185f1196776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:09 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Volume 61a47cca-cf03-4ac4-b642-f256db891961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a47cca-cf03-4ac4-b642-f256db891961', 'volume_size': 1}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 1073741824" returned: 0 in 0.498s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:09 devstack sudo[93334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94
Jul 14 17:54:09 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:09 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94" returned: 0 in 0.246s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.280s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-592968682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a47cca-cf03-4ac4-b642-f256db891961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f392491ab1a420387685deb09b63019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:54:09Z,use_quota=True,user_id='ce44e00e10a041158f9654b04abedc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Creating volume 61a47cca-cf03-4ac4-b642-f256db891961 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:54:09 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:09 devstack sudo[93337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961 1073741824
Jul 14 17:54:09 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef446907-4f10-4d2a-8b1b-be0caeef7fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d976a55-0e79-4dcc-8d7e-372da1ed59fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:09 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Volume volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 (f02c0cc2-7092-44b1-90e9-fa61084c2b94): created successfully
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d976a55-0e79-4dcc-8d7e-372da1ed59fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Flow 'volume_create_manager' (b0bfb520-c40a-423a-b0b7-3ed71edcfbaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e3a0a9ca-3d26-4769-b5f0-e3f7529d4c56 tempest-VolumesSnapshotTestJSON-289733435 None] Created volume successfully.
Jul 14 17:54:09 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961 1073741824" returned: 0 in 0.437s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:09 devstack sudo[93343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961
Jul 14 17:54:09 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:10 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961" returned: 0 in 0.276s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:54:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c2a1b1-81b0-4924-a8b8-0185f1196776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a47cca-cf03-4ac4-b642-f256db891961', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fedc9b-c35a-4b6f-84e0-acf3b4aac7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:10 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Volume volume-61a47cca-cf03-4ac4-b642-f256db891961 (61a47cca-cf03-4ac4-b642-f256db891961): created successfully
Jul 14 17:54:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fedc9b-c35a-4b6f-84e0-acf3b4aac7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Flow 'volume_create_manager' (9986b4df-d7f6-43af-90f4-8fc4281e2408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6753b770-ce67-4340-9af4-f245af15dd80 tempest-AttachVolumeNegativeTest-313902525 None] Created volume successfully.
Jul 14 17:54:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] Creating offline snapshot bc071526-db1b-4375-ad08-afbfe21b044f of volume f02c0cc2-7092-44b1-90e9-fa61084c2b94 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:54:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[db18342c-e171-458d-b1d7-7cc6aefc1047]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:10 devstack sudo[93370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94
Jul 14 17:54:10 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:11 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94" returned: 0 in 0.404s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:11 devstack sudo[93376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f 1G
Jul 14 17:54:11 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:11 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f 1G" returned: 0 in 0.473s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:11 devstack sudo[93385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f
Jul 14 17:54:11 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:12 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f" returned: 0 in 0.491s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:12 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f is being set with open permissions: ugo+rw
Jul 14 17:54:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:12 devstack sudo[93400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f
Jul 14 17:54:12 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-6519643c-b9cb-4b45-985d-63a2a520d126 req-e0125044-8f56-4ef2-a27a-b66155822e4b tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:12 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:12 devstack sudo[93403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.info
Jul 14 17:54:12 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:12 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.info" returned: 0 in 0.316s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:12 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.info is being set with open permissions: ugo+rw
Jul 14 17:54:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:12 devstack sudo[93406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.info
Jul 14 17:54:12 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:13 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.info" returned: 0 in 0.404s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-6519643c-b9cb-4b45-985d-63a2a520d126 req-e0125044-8f56-4ef2-a27a-b66155822e4b tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.020s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa58f4ad-db1e-42e4-8423-89b298df5d14]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-6519643c-b9cb-4b45-985d-63a2a520d126 req-e0125044-8f56-4ef2-a27a-b66155822e4b tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b60a5739-48ab-4f39-b1da-f1d6fd6c39be tempest-VolumesSnapshotTestJSON-289733435 None] Create snapshot completed successfully
Jul 14 17:54:13 devstack sudo[93409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961
Jul 14 17:54:13 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:13 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-6519643c-b9cb-4b45-985d-63a2a520d126 req-e0125044-8f56-4ef2-a27a-b66155822e4b tempest-AttachVolumeNegativeTest-313902525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961" returned: 0 in 0.604s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-6519643c-b9cb-4b45-985d-63a2a520d126 req-e0125044-8f56-4ef2-a27a-b66155822e4b tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.633s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-6519643c-b9cb-4b45-985d-63a2a520d126 req-e0125044-8f56-4ef2-a27a-b66155822e4b tempest-AttachVolumeNegativeTest-313902525 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-61a47cca-cf03-4ac4-b642-f256db891961', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90d64598-c61f-4d8a-9d80-31939374e80a', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:54:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-6519643c-b9cb-4b45-985d-63a2a520d126 req-e0125044-8f56-4ef2-a27a-b66155822e4b tempest-AttachVolumeNegativeTest-313902525 None] attachment_update completed successfully.
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Flow 'volume_create_manager' (5d1eac7a-d276-4204-93a9-3bbff0caa39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47472da-51a6-471c-9d1e-eae47257006f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47472da-51a6-471c-9d1e-eae47257006f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-156158475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afaee0a5-9ded-49f9-9a00-30a6fd84d752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d7c498dc1c4882a8a8d07444a0e6ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:54:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bc071526-db1b-4375-ad08-afbfe21b044f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:54:15Z,use_quota=True,user_id='8edf8f2897634d2f9073116d244c8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c89421-d453-49a1-9cce-8db2d3730e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c89421-d453-49a1-9cce-8db2d3730e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25972fc0-6cb0-4b59-bf25-2e47028da45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25972fc0-6cb0-4b59-bf25-2e47028da45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'afaee0a5-9ded-49f9-9a00-30a6fd84d752', 'volume_name': 'volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752', 'volume_size': 2, 'snapshot_id': 'bc071526-db1b-4375-ad08-afbfe21b044f'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555bce74-5ec7-436d-b7fd-2e60cb52b93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555bce74-5ec7-436d-b7fd-2e60cb52b93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91797030-78a5-4371-a1c8-9eaee30da228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:15 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Volume afaee0a5-9ded-49f9-9a00-30a6fd84d752: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752', 'volume_size': 2, 'snapshot_id': 'bc071526-db1b-4375-ad08-afbfe21b044f'}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-bc071526-db1b-4375-ad08-afbfe21b044f-afaee0a5-9ded-49f9-9a00-30a6fd84d752" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-bc071526-db1b-4375-ad08-afbfe21b044f-afaee0a5-9ded-49f9-9a00-30a6fd84d752" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Creating volume afaee0a5-9ded-49f9-9a00-30a6fd84d752 from snapshot bc071526-db1b-4375-ad08-afbfe21b044f {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-afaee0a5-9ded-49f9-9a00-30a6fd84d752" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-afaee0a5-9ded-49f9-9a00-30a6fd84d752" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] snapshot: bc071526-db1b-4375-ad08-afbfe21b044f, volume: afaee0a5-9ded-49f9-9a00-30a6fd84d752,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd4505e-1c7e-4e0c-a129-3fc6939a06a6]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:15 devstack sudo[93419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f
Jul 14 17:54:15 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:15 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f" returned: 0 in 0.499s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb477b2-db41-49af-9559-4b4477789ee4]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:16 devstack sudo[93424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94
Jul 14 17:54:16 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:16 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94" returned: 0 in 0.554s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:16 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Path /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 17:54:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:16 devstack sudo[93432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752
Jul 14 17:54:16 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-1e4b5d81-31c1-4ebc-9306-3fe4bd659a4b req-060075bc-0f29-43a6-a26c-70a861892f9e tempest-AttachVolumeNegativeTest-313902525 None] Terminate volume connection completed successfully.
Jul 14 17:54:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-1e4b5d81-31c1-4ebc-9306-3fe4bd659a4b req-060075bc-0f29-43a6-a26c-70a861892f9e tempest-AttachVolumeNegativeTest-313902525 None] Deleting attachment 90d64598-c61f-4d8a-9d80-31939374e80a. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:54:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:54:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:20 devstack sudo[93483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:54:20 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:21 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.515s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:54:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:54:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:54:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:54:22 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752" returned: 0 in 6.155s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f721e2-7f5c-4177-9406-a1008bcd4775]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:22 devstack sudo[93489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94
Jul 14 17:54:22 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-26590861-5c40-437d-94f1-239b830f4c3e req-9d47a615-82b7-4314-970e-8416e5c1e2ba tempest-ServerActionsTestOtherA-126595152 None] Terminate volume connection completed successfully.
Jul 14 17:54:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-26590861-5c40-437d-94f1-239b830f4c3e req-9d47a615-82b7-4314-970e-8416e5c1e2ba tempest-ServerActionsTestOtherA-126595152 None] Deleting attachment de4d1a4e-3521-40e0-ba44-f43320b1598b. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:54:23 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94" returned: 0 in 0.700s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:23 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 17:54:23 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Converted 1024.00 MB image at 166.32 MB/s
Jul 14 17:54:23 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752 is being set with open permissions: ugo+rw
Jul 14 17:54:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:23 devstack sudo[93498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752
Jul 14 17:54:23 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:23 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752" returned: 0 in 0.296s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-afaee0a5-9ded-49f9-9a00-30a6fd84d752" released by "_copy_volume_from_snapshot" :: held 8.375s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-bc071526-db1b-4375-ad08-afbfe21b044f-afaee0a5-9ded-49f9-9a00-30a6fd84d752" released by "_create_volume_from_snapshot" :: held 8.421s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.444s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91797030-78a5-4371-a1c8-9eaee30da228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752', 'volume_size': 2, 'snapshot_id': 'bc071526-db1b-4375-ad08-afbfe21b044f'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af883174-8eba-4030-8bb2-bde6f9413933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Volume volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752 (afaee0a5-9ded-49f9-9a00-30a6fd84d752): created successfully
Jul 14 17:54:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af883174-8eba-4030-8bb2-bde6f9413933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Flow 'volume_create_manager' (5d1eac7a-d276-4204-93a9-3bbff0caa39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-81744d68-5bbc-420c-87d9-5d00c9b7aafd tempest-VolumesSnapshotTestJSON-289733435 None] Created volume successfully.
Jul 14 17:54:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-afaee0a5-9ded-49f9-9a00-30a6fd84d752-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-afaee0a5-9ded-49f9-9a00-30a6fd84d752-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-afaee0a5-9ded-49f9-9a00-30a6fd84d752" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-afaee0a5-9ded-49f9-9a00-30a6fd84d752" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bbe73d-eeea-4f80-a783-15a8b8e633a8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:24 devstack sudo[93518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752
Jul 14 17:54:24 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:25 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752" returned: 0 in 0.487s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:25 devstack sudo[93530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752
Jul 14 17:54:25 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:25 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afaee0a5-9ded-49f9-9a00-30a6fd84d752" returned: 0 in 0.290s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-afaee0a5-9ded-49f9-9a00-30a6fd84d752" released by "delete_volume" :: held 0.847s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Created reservations ['a0a5d5e3-8bec-48c7-ad79-9f9e743b08c8', '7fab424c-d2ef-4e36-805c-d46c197902f5', '3a5256da-da8a-49be-a34b-098c89fd885e', '8729a09d-01eb-4f2b-a130-d38024c72acb'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:25 devstack sudo[93533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:54:25 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-bc071526-db1b-4375-ad08-afbfe21b044f-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-bc071526-db1b-4375-ad08-afbfe21b044f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-f02c0cc2-7092-44b1-90e9-fa61084c2b94" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-f02c0cc2-7092-44b1-90e9-fa61084c2b94" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-bc071526-db1b-4375-ad08-afbfe21b044f" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-bc071526-db1b-4375-ad08-afbfe21b044f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Deleting offline snapshot bc071526-db1b-4375-ad08-afbfe21b044f of volume f02c0cc2-7092-44b1-90e9-fa61084c2b94 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:54:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] snapshot_file for this snap is: volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:54:26 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10fe52c-e8f5-461f-9837-531e87091abc]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:26 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.444s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:26 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:54:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Deleted volume successfully.
Jul 14 17:54:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-554590df-dcd5-44e6-92e7-700a698ca0a9 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-afaee0a5-9ded-49f9-9a00-30a6fd84d752-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:26 devstack sudo[93538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f
Jul 14 17:54:26 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:26 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f" returned: 0 in 0.512s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:54:26 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e4851-1c1f-4356-861e-4fef7627d48a]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:26 devstack sudo[93547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94
Jul 14 17:54:26 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:27 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94" returned: 0 in 0.540s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:27 devstack sudo[93553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f
Jul 14 17:54:27 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:27 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f" returned: 0 in 0.523s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:27 devstack sudo[93560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f
Jul 14 17:54:27 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:27 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94.bc071526-db1b-4375-ad08-afbfe21b044f" returned: 0 in 0.293s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-bc071526-db1b-4375-ad08-afbfe21b044f" released by "_delete_snapshot" :: held 2.040s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-f02c0cc2-7092-44b1-90e9-fa61084c2b94" released by "delete_snapshot" :: held 2.078s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:28 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Created reservations ['6629d56c-8536-462b-8bf6-2076fd40895a', '57dae1bc-1e06-4e8b-a5e0-631a6fd84589', '6fd45b34-5987-4d5b-856e-da2939c1e74f', '76ed6eb1-ab85-4926-985c-3175c4a50dc8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:54:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Delete snapshot completed successfully.
Jul 14 17:54:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8dedd35-a186-42cd-9a7f-3d6be84c27c4 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-bc071526-db1b-4375-ad08-afbfe21b044f-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-f02c0cc2-7092-44b1-90e9-fa61084c2b94-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-f02c0cc2-7092-44b1-90e9-fa61084c2b94-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-f02c0cc2-7092-44b1-90e9-fa61084c2b94" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-f02c0cc2-7092-44b1-90e9-fa61084c2b94" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31020ad-e44b-4e5a-b745-a939602f1fdd]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:29 devstack sudo[93580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94
Jul 14 17:54:29 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:29 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94" returned: 0 in 0.393s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:29 devstack sudo[93585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94
Jul 14 17:54:29 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Acquiring lock "cinder-a70b82b7-4134-4622-a211-ad81bce91663-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:30 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f02c0cc2-7092-44b1-90e9-fa61084c2b94" returned: 0 in 0.294s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-f02c0cc2-7092-44b1-90e9-fa61084c2b94" released by "delete_volume" :: held 0.785s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Lock "cinder-a70b82b7-4134-4622-a211-ad81bce91663-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Acquiring lock "cinder-quobyte-a70b82b7-4134-4622-a211-ad81bce91663" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Created reservations ['60589262-73e6-4a2b-a695-f5e1fd4b6310', 'a05f2f80-7f0f-41d3-8484-9665dae8a320', '9eb2d8ea-b93e-41f4-8b83-ebb0f0a73226', '2cac8566-ce3f-455f-b440-332b0cace82a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Lock "cinder-quobyte-a70b82b7-4134-4622-a211-ad81bce91663" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[708b6739-fa1f-4333-8043-5d29dc2f23a1]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:30 devstack sudo[93590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:54:30 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:30 devstack sudo[93589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663
Jul 14 17:54:30 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:30 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663" returned: 0 in 0.570s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:30 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.575s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:30 devstack sudo[93597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663
Jul 14 17:54:30 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:54:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Deleted volume successfully.
Jul 14 17:54:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b83d56ca-34cd-4774-8306-b8775e3214a9 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-f02c0cc2-7092-44b1-90e9-fa61084c2b94-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:31 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a70b82b7-4134-4622-a211-ad81bce91663" returned: 0 in 0.484s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Lock "cinder-quobyte-a70b82b7-4134-4622-a211-ad81bce91663" released by "delete_volume" :: held 1.105s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Created reservations ['6738aac8-ea3b-4105-a24c-9c21a09abc45', '7f877cb8-54ff-441b-bb4b-5700e1d07682', '6891f8b8-d7ac-46ca-acd9-403941d9584f', '9705cb54-670e-49a8-9e8a-202651980db8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Flow 'volume_create_manager' (95b68e8e-639b-4fce-a0d6-005ae103b181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4fe965-dde1-41be-978d-90c8594ed50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4fe965-dde1-41be-978d-90c8594ed50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2016672591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c0f318-d9e6-47a2-81c3-cb063d784ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d7c498dc1c4882a8a8d07444a0e6ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:54:31Z,use_quota=True,user_id='8edf8f2897634d2f9073116d244c8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5091d3-9e4c-4f46-b5b0-d73c044c55f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5091d3-9e4c-4f46-b5b0-d73c044c55f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29aa8341-af99-4589-8da1-1937983be988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29aa8341-af99-4589-8da1-1937983be988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c0f318-d9e6-47a2-81c3-cb063d784ee4', 'volume_name': 'volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc4aaf8-5570-41cd-8c26-fbef7c0aec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc4aaf8-5570-41cd-8c26-fbef7c0aec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d7b08a-29e2-402a-b736-4e32c5cd7bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:31 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Volume b3c0f318-d9e6-47a2-81c3-cb063d784ee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4', 'volume_size': 1}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2016672591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c0f318-d9e6-47a2-81c3-cb063d784ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d7c498dc1c4882a8a8d07444a0e6ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:54:31Z,use_quota=True,user_id='8edf8f2897634d2f9073116d244c8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Creating volume b3c0f318-d9e6-47a2-81c3-cb063d784ee4 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:54:31 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:31 devstack sudo[93604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 1073741824
Jul 14 17:54:31 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:31 devstack sudo[93606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:54:31 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:31 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:31 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:54:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Deleted volume successfully.
Jul 14 17:54:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b99b19ea-3e0f-406b-bc7a-b8ae5f505d95 tempest-ServerActionsTestOtherA-126595152 None] Lock "cinder-a70b82b7-4134-4622-a211-ad81bce91663-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:32 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 1073741824" returned: 0 in 0.758s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:32 devstack sudo[93613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4
Jul 14 17:54:32 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:32 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" returned: 0 in 0.482s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:54:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d7b08a-29e2-402a-b736-4e32c5cd7bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1e5cc1-b90f-457b-a9d1-92f4d1cbd416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Volume volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 (b3c0f318-d9e6-47a2-81c3-cb063d784ee4): created successfully
Jul 14 17:54:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a1e5cc1-b90f-457b-a9d1-92f4d1cbd416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Flow 'volume_create_manager' (95b68e8e-639b-4fce-a0d6-005ae103b181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-26c3cd28-3b27-4b93-a9f9-ec51584f4756 tempest-VolumesSnapshotTestJSON-289733435 None] Created volume successfully.
Jul 14 17:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] Creating offline snapshot de74709e-08db-45bf-877b-c80a08cb7c15 of volume b3c0f318-d9e6-47a2-81c3-cb063d784ee4 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:54:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bf15c2-626f-4a5b-baa0-d26ad3321c37]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:34 devstack sudo[93731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4
Jul 14 17:54:34 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:35 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" returned: 0 in 1.009s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:35 devstack sudo[93760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15 1G
Jul 14 17:54:35 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:36 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15 1G" returned: 0 in 0.808s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:36 devstack sudo[93770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15
Jul 14 17:54:36 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:36 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15" returned: 0 in 0.396s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:36 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15 is being set with open permissions: ugo+rw
Jul 14 17:54:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:36 devstack sudo[93776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15
Jul 14 17:54:36 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:37 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15" returned: 0 in 0.555s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:37 devstack sudo[93780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.info
Jul 14 17:54:37 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:37 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.info" returned: 0 in 0.442s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:37 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.info is being set with open permissions: ugo+rw
Jul 14 17:54:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:37 devstack sudo[93783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.info
Jul 14 17:54:37 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:38 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.info" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.806s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4f4c83b2-f770-4821-862d-5f86ed01034e tempest-VolumesSnapshotTestJSON-289733435 None] Create snapshot completed successfully
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Flow 'volume_create_manager' (64222dc6-cd2e-4f4d-ac78-57d154099702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a390a3dc-9c5e-46e9-9663-889cf694e4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a390a3dc-9c5e-46e9-9663-889cf694e4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1879415885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8abcdd-be46-41d5-908f-e50c7da47f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d7c498dc1c4882a8a8d07444a0e6ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de74709e-08db-45bf-877b-c80a08cb7c15,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:54:39Z,use_quota=True,user_id='8edf8f2897634d2f9073116d244c8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207e7fd8-8f8c-4c0b-b882-fd564d877e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207e7fd8-8f8c-4c0b-b882-fd564d877e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc7314a-fd25-4924-ab97-c935fd68de09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc7314a-fd25-4924-ab97-c935fd68de09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f8abcdd-be46-41d5-908f-e50c7da47f19', 'volume_name': 'volume-3f8abcdd-be46-41d5-908f-e50c7da47f19', 'volume_size': 1, 'snapshot_id': 'de74709e-08db-45bf-877b-c80a08cb7c15'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d6c7a8-5250-4e05-ab34-9c4981e8356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d6c7a8-5250-4e05-ab34-9c4981e8356b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fc074d-2644-4312-840d-604b08498e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:39 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Volume 3f8abcdd-be46-41d5-908f-e50c7da47f19: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f8abcdd-be46-41d5-908f-e50c7da47f19', 'volume_size': 1, 'snapshot_id': 'de74709e-08db-45bf-877b-c80a08cb7c15'}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-de74709e-08db-45bf-877b-c80a08cb7c15-3f8abcdd-be46-41d5-908f-e50c7da47f19" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-de74709e-08db-45bf-877b-c80a08cb7c15-3f8abcdd-be46-41d5-908f-e50c7da47f19" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Creating volume 3f8abcdd-be46-41d5-908f-e50c7da47f19 from snapshot de74709e-08db-45bf-877b-c80a08cb7c15 {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-3f8abcdd-be46-41d5-908f-e50c7da47f19" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-3f8abcdd-be46-41d5-908f-e50c7da47f19" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] snapshot: de74709e-08db-45bf-877b-c80a08cb7c15, volume: 3f8abcdd-be46-41d5-908f-e50c7da47f19,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec158fe-5d56-4c26-bcdb-84ffd1d2353d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:39 devstack sudo[93790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15
Jul 14 17:54:39 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:40 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15" returned: 0 in 0.826s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:54:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 17:54:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 17:54:40 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087dae6-5564-4f2d-8a9d-81010228ea94]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:40 devstack sudo[93831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4
Jul 14 17:54:40 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:41 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" returned: 0 in 1.029s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:41 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Path /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 17:54:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:41 devstack sudo[93865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19
Jul 14 17:54:41 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:43 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=84,cinder:UPDATE=74,cinder:DELETE=10,cinder:INSERT=20 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:54:43 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=86,cinder:UPDATE=83,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:54:51 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19" returned: 0 in 9.589s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cef67f-e3f1-4b6f-a29b-ca9e9137ef84]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:51 devstack sudo[93931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4
Jul 14 17:54:51 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:51 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" returned: 0 in 0.772s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:51 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4, size 1024.00 MB, duration 9.59 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 17:54:51 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Converted 1024.00 MB image at 106.77 MB/s
Jul 14 17:54:51 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19 is being set with open permissions: ugo+rw
Jul 14 17:54:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:51 devstack sudo[93938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19
Jul 14 17:54:51 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:52 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19" returned: 0 in 0.406s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-3f8abcdd-be46-41d5-908f-e50c7da47f19" released by "_copy_volume_from_snapshot" :: held 12.775s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-de74709e-08db-45bf-877b-c80a08cb7c15-3f8abcdd-be46-41d5-908f-e50c7da47f19" released by "_create_volume_from_snapshot" :: held 12.813s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.834s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fc074d-2644-4312-840d-604b08498e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8abcdd-be46-41d5-908f-e50c7da47f19', 'volume_size': 1, 'snapshot_id': 'de74709e-08db-45bf-877b-c80a08cb7c15'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66579872-df2f-4afe-8635-401f6d0cb022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:52 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Volume volume-3f8abcdd-be46-41d5-908f-e50c7da47f19 (3f8abcdd-be46-41d5-908f-e50c7da47f19): created successfully
Jul 14 17:54:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66579872-df2f-4afe-8635-401f6d0cb022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Flow 'volume_create_manager' (64222dc6-cd2e-4f4d-ac78-57d154099702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3255b20d-2251-45d7-af3d-245b7fba3cce tempest-VolumesSnapshotTestJSON-289733435 None] Created volume successfully.
Jul 14 17:54:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-3f8abcdd-be46-41d5-908f-e50c7da47f19-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-3f8abcdd-be46-41d5-908f-e50c7da47f19-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-3f8abcdd-be46-41d5-908f-e50c7da47f19" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-3f8abcdd-be46-41d5-908f-e50c7da47f19" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:53 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a979f35-24d1-4f50-9af6-719b8ccacd3c]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:53 devstack sudo[93947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19
Jul 14 17:54:53 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:53 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19" returned: 0 in 0.430s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:53 devstack sudo[93955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19
Jul 14 17:54:53 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:54 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3f8abcdd-be46-41d5-908f-e50c7da47f19" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-3f8abcdd-be46-41d5-908f-e50c7da47f19" released by "delete_volume" :: held 0.787s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Created reservations ['416a4445-7fdb-40e7-9a1b-300ee72a3a59', '74097bbd-b406-4e7e-b7d3-7023e0280144', '2fcf5501-bd34-4e1e-8941-35728b41d7ac', '80942555-8bcd-4e31-ab84-fd50dd1ce99d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:54 devstack sudo[93958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:54:54 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-de74709e-08db-45bf-877b-c80a08cb7c15-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:54 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:54:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Deleted volume successfully.
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-de74709e-08db-45bf-877b-c80a08cb7c15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5fe3ba47-7892-4816-8d95-b1fd0146529a tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-3f8abcdd-be46-41d5-908f-e50c7da47f19-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-de74709e-08db-45bf-877b-c80a08cb7c15" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-de74709e-08db-45bf-877b-c80a08cb7c15" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Deleting offline snapshot de74709e-08db-45bf-877b-c80a08cb7c15 of volume b3c0f318-d9e6-47a2-81c3-cb063d784ee4 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] snapshot_file for this snap is: volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ba6147-87e0-4746-9cff-1154fad330d8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:54 devstack sudo[93961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15
Jul 14 17:54:54 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:54 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15" returned: 0 in 0.406s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:54:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2dd1d0-1bdd-48ee-9392-26b28289ac5e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:55 devstack sudo[93966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4
Jul 14 17:54:55 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:55 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" returned: 0 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:55 devstack sudo[93971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15
Jul 14 17:54:55 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:55 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15" returned: 0 in 0.411s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:55 devstack sudo[93998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15
Jul 14 17:54:55 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:56 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4.de74709e-08db-45bf-877b-c80a08cb7c15" returned: 0 in 0.283s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-de74709e-08db-45bf-877b-c80a08cb7c15" released by "_delete_snapshot" :: held 1.587s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" released by "delete_snapshot" :: held 1.611s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:56 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Created reservations ['cd3c48ab-9e36-485c-a769-a41e9ced18c7', 'd6aff02a-8fdb-4ed8-b8e9-943fb5695828', '44f4376b-3f88-48c1-a6bf-c1ba591a498b', 'cd23f15c-7c41-46ab-866b-9a1093fcb369'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:54:56 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Delete snapshot completed successfully.
Jul 14 17:54:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0f0d8ce1-ecc9-4580-8576-833cfcd41564 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-de74709e-08db-45bf-877b-c80a08cb7c15-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-b3c0f318-d9e6-47a2-81c3-cb063d784ee4-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-b3c0f318-d9e6-47a2-81c3-cb063d784ee4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9a4a79-b133-40f8-8573-ddd74f44c25f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:56 devstack sudo[94001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4
Jul 14 17:54:56 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:57 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" returned: 0 in 0.374s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:57 devstack sudo[94006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4
Jul 14 17:54:57 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:54:57 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Flow 'volume_create_manager' (ad7169f3-e540-41fe-a506-d41f954f892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b454e8-7364-48da-8858-47298ec107b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" returned: 0 in 0.363s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b454e8-7364-48da-8858-47298ec107b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-659236203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8e006e-5b4d-4099-807d-3648f9d4ddd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c66da9d45fe401d9997a5efcf35a195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:54:57Z,use_quota=True,user_id='f969f43efc6741c7af59067cf52ebd33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fedd0698-a3bf-44fb-b6d6-820693962143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fedd0698-a3bf-44fb-b6d6-820693962143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74414798-f128-411e-80ed-c51f8cc199a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74414798-f128-411e-80ed-c51f8cc199a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8e006e-5b4d-4099-807d-3648f9d4ddd0', 'volume_name': 'volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b7117c-315b-49b6-867f-18b3c9ffb155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b7117c-315b-49b6-867f-18b3c9ffb155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624b03ff-7d54-4186-bb9e-03da77517e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Volume 1b8e006e-5b4d-4099-807d-3648f9d4ddd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0', 'volume_size': 1}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-659236203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8e006e-5b4d-4099-807d-3648f9d4ddd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c66da9d45fe401d9997a5efcf35a195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:54:57Z,use_quota=True,user_id='f969f43efc6741c7af59067cf52ebd33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Creating volume 1b8e006e-5b4d-4099-807d-3648f9d4ddd0 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:54:57 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-b3c0f318-d9e6-47a2-81c3-cb063d784ee4" released by "delete_volume" :: held 0.864s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:57 devstack sudo[94009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0 1073741824
Jul 14 17:54:57 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Created reservations ['364d0ed7-3d5b-46ed-a57b-72120c585ad7', 'fb83fcb3-5f34-47e3-8921-2ef497d31804', '4c6973ec-5791-4a76-aec4-b2b8a7638c55', 'f593f344-4c95-4aa5-b55f-c6f001078362'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:57 devstack sudo[94011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:54:57 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-31e05901-a34b-46db-bfcb-14c18f48fbce-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-31e05901-a34b-46db-bfcb-14c18f48fbce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "cinder-quobyte-31e05901-a34b-46db-bfcb-14c18f48fbce" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-31e05901-a34b-46db-bfcb-14c18f48fbce" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a091a986-18af-4d12-8486-fd567bf5f430]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:58 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.348s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:54:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Deleted volume successfully.
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-874d7c5e-e2e6-4ead-9424-bdc132000404 tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-b3c0f318-d9e6-47a2-81c3-cb063d784ee4-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:58 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0 1073741824" returned: 0 in 0.608s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:58 devstack sudo[94017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce
Jul 14 17:54:58 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:58 devstack sudo[94019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0
Jul 14 17:54:58 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:58 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:58 devstack sudo[94025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce
Jul 14 17:54:58 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:58 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0" returned: 0 in 0.281s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624b03ff-7d54-4186-bb9e-03da77517e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cf148b-9dfb-4d9d-a250-175d944d391f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:54:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Volume volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0 (1b8e006e-5b4d-4099-807d-3648f9d4ddd0): created successfully
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cf148b-9dfb-4d9d-a250-175d944d391f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Flow 'volume_create_manager' (ad7169f3-e540-41fe-a506-d41f954f892a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:54:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-52b29ba1-bf22-4825-bb48-f50d755b9ae9 tempest-VolumesTestJSON-1626832259 None] Created volume successfully.
Jul 14 17:54:58 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-31e05901-a34b-46db-bfcb-14c18f48fbce" returned: 0 in 0.268s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-quobyte-31e05901-a34b-46db-bfcb-14c18f48fbce" released by "delete_volume" :: held 0.735s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Created reservations ['c8c3a62f-d088-4aef-8dc8-e8e4ef459354', '88e80e4c-0caa-49c8-8d7f-8197b7babf72', 'c28a249e-92f6-4afe-b90f-74e70b406a35', '24aa533f-6b91-49ed-878d-24069b35c302'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:54:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:54:58 devstack sudo[94028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:54:58 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:54:59 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root
Jul 14 17:54:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.261s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:54:59 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:54:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Deleted volume successfully.
Jul 14 17:54:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9cac5132-bbbb-46bd-bedb-d7b8442173cc tempest-VolumesSnapshotTestJSON-289733435 None] Lock "cinder-31e05901-a34b-46db-bfcb-14c18f48fbce-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Flow 'volume_create_manager' (cbd236ff-bf2f-41f1-9d3f-2ed45975e16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b41c87-ebe3-4d46-9c77-6402cacff27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b41c87-ebe3-4d46-9c77-6402cacff27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-637653751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fd8b60-b924-4254-8a3d-948bd12cbb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59370d7652b844de83ec4a59219e8794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:00Z,use_quota=True,user_id='9b2a315a757b47aca532258c6e86799c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a99525-b8e3-4528-bad9-f9f6141bf682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a99525-b8e3-4528-bad9-f9f6141bf682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9be088-a790-4760-9dd3-471df20482a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9be088-a790-4760-9dd3-471df20482a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fd8b60-b924-4254-8a3d-948bd12cbb9e', 'volume_name': 'volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc8ff43-2a6a-4211-b127-017228d5ee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc8ff43-2a6a-4211-b127-017228d5ee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c43255-67bd-4b53-ae38-2c9fa35b720a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Volume 95fd8b60-b924-4254-8a3d-948bd12cbb9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e', 'volume_size': 1}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-637653751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fd8b60-b924-4254-8a3d-948bd12cbb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59370d7652b844de83ec4a59219e8794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:00Z,use_quota=True,user_id='9b2a315a757b47aca532258c6e86799c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Creating volume 95fd8b60-b924-4254-8a3d-948bd12cbb9e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:55:00 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:00 devstack sudo[94040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e 1073741824
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:55:00 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Flow 'volume_create_manager' (d5fc1a5e-63f2-41f2-b048-1a527d48870a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86cf2b4-b3c6-4fbc-b3af-779d7114627a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86cf2b4-b3c6-4fbc-b3af-779d7114627a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-617553466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6b469e-90e3-462d-bc5f-da34c874079d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c66da9d45fe401d9997a5efcf35a195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:00Z,use_quota=True,user_id='f969f43efc6741c7af59067cf52ebd33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fc6552-4216-46a1-b996-95a4de564354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fc6552-4216-46a1-b996-95a4de564354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0758224d-7d58-4d4c-ba34-8cae4d0e2339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0758224d-7d58-4d4c-ba34-8cae4d0e2339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a6b469e-90e3-462d-bc5f-da34c874079d', 'volume_name': 'volume-3a6b469e-90e3-462d-bc5f-da34c874079d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf555688-9563-452f-a5e4-ded066a27436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf555688-9563-452f-a5e4-ded066a27436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865fb83d-6d3e-4fec-b074-b9feb35fb3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Volume 3a6b469e-90e3-462d-bc5f-da34c874079d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a6b469e-90e3-462d-bc5f-da34c874079d', 'volume_size': 1}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:00 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e 1073741824" returned: 0 in 0.478s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:00 devstack sudo[94047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e
Jul 14 17:55:00 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:01 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e" returned: 0 in 0.270s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.678s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-617553466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6b469e-90e3-462d-bc5f-da34c874079d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c66da9d45fe401d9997a5efcf35a195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:00Z,use_quota=True,user_id='f969f43efc6741c7af59067cf52ebd33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Creating volume 3a6b469e-90e3-462d-bc5f-da34c874079d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:55:01 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3a6b469e-90e3-462d-bc5f-da34c874079d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c43255-67bd-4b53-ae38-2c9fa35b720a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7b4567-74ab-474a-bd3c-f24fde3ff12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:01 devstack sudo[94050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3a6b469e-90e3-462d-bc5f-da34c874079d 1073741824
Jul 14 17:55:01 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Volume volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e (95fd8b60-b924-4254-8a3d-948bd12cbb9e): created successfully
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7b4567-74ab-474a-bd3c-f24fde3ff12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Flow 'volume_create_manager' (cbd236ff-bf2f-41f1-9d3f-2ed45975e16e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2c4eefe8-12f2-4890-9715-f0e71ef5defb tempest-AttachVolumeTestJSON-2039261099 None] Created volume successfully.
Jul 14 17:55:01 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3a6b469e-90e3-462d-bc5f-da34c874079d 1073741824" returned: 0 in 0.442s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3a6b469e-90e3-462d-bc5f-da34c874079d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:01 devstack sudo[94059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3a6b469e-90e3-462d-bc5f-da34c874079d
Jul 14 17:55:01 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:01 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3a6b469e-90e3-462d-bc5f-da34c874079d" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865fb83d-6d3e-4fec-b074-b9feb35fb3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a6b469e-90e3-462d-bc5f-da34c874079d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705c2c12-bdea-4ce0-9b72-f79a05a31b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Volume volume-3a6b469e-90e3-462d-bc5f-da34c874079d (3a6b469e-90e3-462d-bc5f-da34c874079d): created successfully
Jul 14 17:55:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705c2c12-bdea-4ce0-9b72-f79a05a31b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Flow 'volume_create_manager' (d5fc1a5e-63f2-41f2-b048-1a527d48870a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-133408d2-70d2-48d6-b527-9f4672f6a79e tempest-VolumesTestJSON-1626832259 None] Created volume successfully.
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Flow 'volume_create_manager' (881c9ec5-4194-4624-9436-05bc33b6fc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bed3efd-8180-4d6f-9aab-a72e32581957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bed3efd-8180-4d6f-9aab-a72e32581957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-868163341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d504aea0-20ba-4aed-a774-48976ff89b0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c66da9d45fe401d9997a5efcf35a195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:03Z,use_quota=True,user_id='f969f43efc6741c7af59067cf52ebd33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ed03e6-dfb1-4517-9150-73cc91e0802c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ed03e6-dfb1-4517-9150-73cc91e0802c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7507ec-ebfa-4716-9bb7-1c9f802bd964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7507ec-ebfa-4716-9bb7-1c9f802bd964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd504aea0-20ba-4aed-a774-48976ff89b0c', 'volume_name': 'volume-d504aea0-20ba-4aed-a774-48976ff89b0c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a60a00-48e7-466d-bd95-06a49f5e7d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a60a00-48e7-466d-bd95-06a49f5e7d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b27f240-65df-4d9c-a81f-60ea8de0db8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Volume d504aea0-20ba-4aed-a774-48976ff89b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d504aea0-20ba-4aed-a774-48976ff89b0c', 'volume_size': 1}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-868163341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d504aea0-20ba-4aed-a774-48976ff89b0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c66da9d45fe401d9997a5efcf35a195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:03Z,use_quota=True,user_id='f969f43efc6741c7af59067cf52ebd33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Creating volume d504aea0-20ba-4aed-a774-48976ff89b0c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:55:03 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d504aea0-20ba-4aed-a774-48976ff89b0c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:03 devstack sudo[94075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d504aea0-20ba-4aed-a774-48976ff89b0c 1073741824
Jul 14 17:55:03 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-4521730f-b58c-4243-bc3d-998470a529be req-9651feab-72fe-4e3c-aa00-099a5ec9aa22 tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:03 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d504aea0-20ba-4aed-a774-48976ff89b0c 1073741824" returned: 0 in 0.605s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d504aea0-20ba-4aed-a774-48976ff89b0c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:03 devstack sudo[94082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d504aea0-20ba-4aed-a774-48976ff89b0c
Jul 14 17:55:03 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:04 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d504aea0-20ba-4aed-a774-48976ff89b0c" returned: 0 in 0.330s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-4521730f-b58c-4243-bc3d-998470a529be req-9651feab-72fe-4e3c-aa00-099a5ec9aa22 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.745s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b27f240-65df-4d9c-a81f-60ea8de0db8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d504aea0-20ba-4aed-a774-48976ff89b0c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1f0280-1442-4aca-a7b0-2e14db350859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[462b3946-bd17-4bf2-804e-54cac396a150]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-4521730f-b58c-4243-bc3d-998470a529be req-9651feab-72fe-4e3c-aa00-099a5ec9aa22 tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Volume volume-d504aea0-20ba-4aed-a774-48976ff89b0c (d504aea0-20ba-4aed-a774-48976ff89b0c): created successfully
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1f0280-1442-4aca-a7b0-2e14db350859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Flow 'volume_create_manager' (881c9ec5-4194-4624-9436-05bc33b6fc1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6f65a0d4-1ca7-48fa-8931-928426d37484 tempest-VolumesTestJSON-1626832259 None] Created volume successfully.
Jul 14 17:55:04 devstack sudo[94085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e
Jul 14 17:55:04 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:04 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-4521730f-b58c-4243-bc3d-998470a529be req-9651feab-72fe-4e3c-aa00-099a5ec9aa22 tempest-AttachVolumeTestJSON-2039261099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e" returned: 0 in 0.420s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-4521730f-b58c-4243-bc3d-998470a529be req-9651feab-72fe-4e3c-aa00-099a5ec9aa22 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.467s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-4521730f-b58c-4243-bc3d-998470a529be req-9651feab-72fe-4e3c-aa00-099a5ec9aa22 tempest-AttachVolumeTestJSON-2039261099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a143141-fba7-4af0-af42-4b43c6f5f7d8', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:55:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-4521730f-b58c-4243-bc3d-998470a529be req-9651feab-72fe-4e3c-aa00-099a5ec9aa22 tempest-AttachVolumeTestJSON-2039261099 None] attachment_update completed successfully.
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Flow 'volume_create_manager' (3c6270f9-eca9-4835-a53b-e10eb8be95eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd9cbf4-f619-4bde-9fbf-043372ca36a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd9cbf4-f619-4bde-9fbf-043372ca36a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-76755572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd246cc2-5908-45cf-a9a3-d3dd0df39d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cb23ce0cb449d0886a380353dcc3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:06Z,use_quota=True,user_id='102262d826b04fdca01a5803987106dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6098d0-546b-42ac-94ff-f2a7b353f962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6098d0-546b-42ac-94ff-f2a7b353f962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b756ce1e-10b2-4b4a-977e-5a368adc3ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b756ce1e-10b2-4b4a-977e-5a368adc3ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd246cc2-5908-45cf-a9a3-d3dd0df39d53', 'volume_name': 'volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c79164-743b-4ae7-9b36-d4d66b1e8941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c79164-743b-4ae7-9b36-d4d66b1e8941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0808eb-16a8-4dde-a48d-62c9b0daeab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Volume fd246cc2-5908-45cf-a9a3-d3dd0df39d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53', 'volume_size': 1}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-76755572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd246cc2-5908-45cf-a9a3-d3dd0df39d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cb23ce0cb449d0886a380353dcc3b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:06Z,use_quota=True,user_id='102262d826b04fdca01a5803987106dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Creating volume fd246cc2-5908-45cf-a9a3-d3dd0df39d53 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:55:06 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:06 devstack sudo[94804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53 1073741824
Jul 14 17:55:06 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Acquiring lock "cinder-d504aea0-20ba-4aed-a774-48976ff89b0c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Lock "cinder-d504aea0-20ba-4aed-a774-48976ff89b0c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Flow 'volume_create_manager' (4c0172b8-5617-4682-8244-60d55167c604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a1c8d5-d4cf-4828-9da2-0ea6065b8a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a1c8d5-d4cf-4828-9da2-0ea6065b8a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-186971091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf530303-1960-475e-9c49-1c296bea4ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f392491ab1a420387685deb09b63019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:06Z,use_quota=True,user_id='ce44e00e10a041158f9654b04abedc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84220434-bbf4-48f4-9e09-ae33ae990667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84220434-bbf4-48f4-9e09-ae33ae990667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78e13cd-80ec-4e2c-a103-b68b3baacdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78e13cd-80ec-4e2c-a103-b68b3baacdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf530303-1960-475e-9c49-1c296bea4ec6', 'volume_name': 'volume-cf530303-1960-475e-9c49-1c296bea4ec6', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f803b2d-e270-4921-b4c9-994af110ab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f803b2d-e270-4921-b4c9-994af110ab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70d4610-40d4-4079-8701-23d06ebf5ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Volume cf530303-1960-475e-9c49-1c296bea4ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf530303-1960-475e-9c49-1c296bea4ec6', 'volume_size': 1}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Acquiring lock "cinder-quobyte-d504aea0-20ba-4aed-a774-48976ff89b0c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Lock "cinder-quobyte-d504aea0-20ba-4aed-a774-48976ff89b0c" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bb19ed-6268-48c7-a7fc-6b15f366c4ee]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d504aea0-20ba-4aed-a774-48976ff89b0c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:06 devstack sudo[94811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d504aea0-20ba-4aed-a774-48976ff89b0c
Jul 14 17:55:06 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:06 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53 1073741824" returned: 0 in 0.600s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:07 devstack sudo[94813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53
Jul 14 17:55:07 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:07 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d504aea0-20ba-4aed-a774-48976ff89b0c" returned: 0 in 0.471s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d504aea0-20ba-4aed-a774-48976ff89b0c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:07 devstack sudo[94823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d504aea0-20ba-4aed-a774-48976ff89b0c
Jul 14 17:55:07 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:07 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" returned: 0 in 0.302s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-186971091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf530303-1960-475e-9c49-1c296bea4ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f392491ab1a420387685deb09b63019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:06Z,use_quota=True,user_id='ce44e00e10a041158f9654b04abedc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Creating volume cf530303-1960-475e-9c49-1c296bea4ec6 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:55:07 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0808eb-16a8-4dde-a48d-62c9b0daeab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:07 devstack sudo[94826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6 1073741824
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c440fc-669c-4970-b30b-fd149a6c0b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:07 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:07 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Volume volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53 (fd246cc2-5908-45cf-a9a3-d3dd0df39d53): created successfully
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c440fc-669c-4970-b30b-fd149a6c0b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Flow 'volume_create_manager' (3c6270f9-eca9-4835-a53b-e10eb8be95eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-22306ee5-4b69-47e9-8333-3f36ff9e77f0 tempest-VolumesSnapshotListTestJSON-1470289129 None] Created volume successfully.
Jul 14 17:55:07 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d504aea0-20ba-4aed-a774-48976ff89b0c" returned: 0 in 0.270s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Lock "cinder-quobyte-d504aea0-20ba-4aed-a774-48976ff89b0c" released by "delete_volume" :: held 0.793s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Created reservations ['9c03e6a7-4958-4ba6-a8e8-b21f19a94107', '5284b490-0f83-4804-99e1-edfea671e2cc', 'f4087b4f-ce36-4bc2-b917-c99a64578341', 'c31ef306-e120-41eb-aeb3-ec5aec7fa1e4'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:07 devstack sudo[94832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:55:07 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Acquiring lock "cinder-3a6b469e-90e3-462d-bc5f-da34c874079d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Lock "cinder-3a6b469e-90e3-462d-bc5f-da34c874079d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Acquiring lock "cinder-quobyte-3a6b469e-90e3-462d-bc5f-da34c874079d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Lock "cinder-quobyte-3a6b469e-90e3-462d-bc5f-da34c874079d" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1888f7f5-f6dd-4bb9-9671-3a186a2e7d36]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3a6b469e-90e3-462d-bc5f-da34c874079d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:07 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6 1073741824" returned: 0 in 0.529s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:07 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.282s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:55:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Deleted volume successfully.
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:07 devstack sudo[94835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3a6b469e-90e3-462d-bc5f-da34c874079d
Jul 14 17:55:07 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a3834a93-6580-4473-82f9-37090cd358e8 tempest-VolumesTestJSON-1626832259 None] Lock "cinder-d504aea0-20ba-4aed-a774-48976ff89b0c-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:07 devstack sudo[94836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6
Jul 14 17:55:07 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:08 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70d4610-40d4-4079-8701-23d06ebf5ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf530303-1960-475e-9c49-1c296bea4ec6', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff53d8e0-2112-404b-a432-490d5b02f87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:08 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Volume volume-cf530303-1960-475e-9c49-1c296bea4ec6 (cf530303-1960-475e-9c49-1c296bea4ec6): created successfully
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff53d8e0-2112-404b-a432-490d5b02f87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:08 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Flow 'volume_create_manager' (4c0172b8-5617-4682-8244-60d55167c604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3a6b469e-90e3-462d-bc5f-da34c874079d" returned: 0 in 0.425s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3a6b469e-90e3-462d-bc5f-da34c874079d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b74d7b45-bad6-4333-9d95-694e7362b938 tempest-AttachVolumeNegativeTest-313902525 None] Created volume successfully.
Jul 14 17:55:08 devstack sudo[94843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3a6b469e-90e3-462d-bc5f-da34c874079d
Jul 14 17:55:08 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:08 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3a6b469e-90e3-462d-bc5f-da34c874079d" returned: 0 in 0.279s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Lock "cinder-quobyte-3a6b469e-90e3-462d-bc5f-da34c874079d" released by "delete_volume" :: held 0.762s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] Creating offline snapshot 92f85eb3-dedf-4365-8034-cfc50f387eea of volume fd246cc2-5908-45cf-a9a3-d3dd0df39d53 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6aad71-d2e1-4ec2-9cbc-2a57c8a3a085]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Created reservations ['3f7b7713-f513-4322-b299-0956cddd7587', '93939d42-1bf4-4e88-80ac-7517ce18464b', '1d3b1ff2-3ff0-4308-8a4f-8dd6a039756d', '52d496e5-0a87-4f9b-9298-d24eaa949872'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:08 devstack sudo[94847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53
Jul 14 17:55:08 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:08 devstack sudo[94851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:55:08 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Acquiring lock "cinder-1b8e006e-5b4d-4099-807d-3648f9d4ddd0-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Lock "cinder-1b8e006e-5b4d-4099-807d-3648f9d4ddd0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Acquiring lock "cinder-quobyte-1b8e006e-5b4d-4099-807d-3648f9d4ddd0" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Lock "cinder-quobyte-1b8e006e-5b4d-4099-807d-3648f9d4ddd0" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:09 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" returned: 0 in 0.527s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[685dae5c-6b71-4f44-b774-efce7d3e5ff4]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:09 devstack sudo[94859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea 1G
Jul 14 17:55:09 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:09 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.513s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:55:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Deleted volume successfully.
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fcd4c2eb-c638-46a5-8795-eefe54341ac2 tempest-VolumesTestJSON-1626832259 None] Lock "cinder-3a6b469e-90e3-462d-bc5f-da34c874079d-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:09 devstack sudo[94860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0
Jul 14 17:55:09 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-25343050-62ed-46c1-9198-55ada9770537 req-26645eae-4719-4a02-8b70-658a84ab006e tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:09 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0" returned: 0 in 0.545s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:09 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea 1G" returned: 0 in 0.593s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:09 devstack sudo[94888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea
Jul 14 17:55:09 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:09 devstack sudo[94882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0
Jul 14 17:55:09 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:10 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:10 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea" returned: 0 in 0.594s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:10 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea is being set with open permissions: ugo+rw
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b8e006e-5b4d-4099-807d-3648f9d4ddd0" returned: 0 in 0.639s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:10 devstack sudo[95083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea
Jul 14 17:55:10 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Lock "cinder-quobyte-1b8e006e-5b4d-4099-807d-3648f9d4ddd0" released by "delete_volume" :: held 1.274s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Created reservations ['d51ca11d-ba2e-4b40-b457-39d1d29ba3cf', '3190e5f6-bf72-4ee0-81cd-5148e43cabe9', '6dd9cd77-d785-4e78-9351-1e8bdf093e94', 'c5abd28c-36aa-48e0-a0ed-314b6cd39dc8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:10 devstack sudo[95086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:55:10 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:10 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea" returned: 0 in 0.419s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:10 devstack sudo[95093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.info
Jul 14 17:55:10 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:10 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.315s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:55:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Deleted volume successfully.
Jul 14 17:55:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-075b8504-878c-43b0-806c-1017d601eaca tempest-VolumesTestJSON-1626832259 None] Lock "cinder-1b8e006e-5b4d-4099-807d-3648f9d4ddd0-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:11 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.info" returned: 0 in 0.271s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:11 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.info is being set with open permissions: ugo+rw
Jul 14 17:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:11 devstack sudo[95105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.info
Jul 14 17:55:11 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:11 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.info" returned: 0 in 0.398s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.973s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-25343050-62ed-46c1-9198-55ada9770537 req-26645eae-4719-4a02-8b70-658a84ab006e tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.886s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c56110-3755-4d8f-8a75-1cb82485ad12]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-25343050-62ed-46c1-9198-55ada9770537 req-26645eae-4719-4a02-8b70-658a84ab006e tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3fb6ac5a-85f9-432a-9c11-81f397aabe1a tempest-VolumesSnapshotListTestJSON-1470289129 None] Create snapshot completed successfully
Jul 14 17:55:11 devstack sudo[95459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6
Jul 14 17:55:11 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:12 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-25343050-62ed-46c1-9198-55ada9770537 req-26645eae-4719-4a02-8b70-658a84ab006e tempest-AttachVolumeNegativeTest-313902525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6" returned: 0 in 0.807s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-25343050-62ed-46c1-9198-55ada9770537 req-26645eae-4719-4a02-8b70-658a84ab006e tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.278s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] Creating offline snapshot 0a9c2b83-c653-4ccc-bf13-506c30e8d0ee of volume fd246cc2-5908-45cf-a9a3-d3dd0df39d53 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:55:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa05825-3174-48c2-90f8-3ac9d3b03b10]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-25343050-62ed-46c1-9198-55ada9770537 req-26645eae-4719-4a02-8b70-658a84ab006e tempest-AttachVolumeNegativeTest-313902525 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-cf530303-1960-475e-9c49-1c296bea4ec6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a3089b2-40ed-4935-ab20-eb5462036333', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:55:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-25343050-62ed-46c1-9198-55ada9770537 req-26645eae-4719-4a02-8b70-658a84ab006e tempest-AttachVolumeNegativeTest-313902525 None] attachment_update completed successfully.
Jul 14 17:55:12 devstack sudo[95493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea
Jul 14 17:55:12 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:13 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea" returned: 0 in 0.576s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:55:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:13 devstack sudo[95503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee 1G
Jul 14 17:55:13 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:13 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee 1G" returned: 0 in 0.802s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:13 devstack sudo[95511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee
Jul 14 17:55:13 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:14 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee" returned: 0 in 0.468s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:14 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee is being set with open permissions: ugo+rw
Jul 14 17:55:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:14 devstack sudo[95519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee
Jul 14 17:55:14 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:14 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee" returned: 0 in 0.390s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-87af19a1-822f-482c-a8cc-815b186a88f1 tempest-VolumesSnapshotListTestJSON-1470289129 None] Create snapshot completed successfully
Jul 14 17:55:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-f5fd1f2e-c93d-4b1f-bd95-3cacbcaa639a req-6b6aa474-647c-453f-b3ae-6f52c8d6e28d tempest-AttachVolumeNegativeTest-313902525 None] Terminate volume connection completed successfully.
Jul 14 17:55:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-f5fd1f2e-c93d-4b1f-bd95-3cacbcaa639a req-6b6aa474-647c-453f-b3ae-6f52c8d6e28d tempest-AttachVolumeNegativeTest-313902525 None] Deleting attachment 0a3089b2-40ed-4935-ab20-eb5462036333. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:55:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] Creating offline snapshot de9d1f95-7077-4465-9d95-7aed92d9c214 of volume fd246cc2-5908-45cf-a9a3-d3dd0df39d53 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:55:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb58467-b01f-4aec-adbb-5a58431811b7]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:15 devstack sudo[95525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee
Jul 14 17:55:15 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:16 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee" returned: 0 in 0.536s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:55:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:16 devstack sudo[95532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214 1G
Jul 14 17:55:16 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:17 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214 1G" returned: 0 in 0.988s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:17 devstack sudo[95558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214
Jul 14 17:55:17 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c71da19a-23b9-43d4-97c4-3a91e42a5c26 tempest-BackendsCapabilitiesAdminTestsJSON-140462277 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87401) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 14 17:55:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3725efe0-bbb9-4532-855e-f4570951414e tempest-BackendsCapabilitiesAdminTestsJSON-140462277 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87401) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 14 17:55:17 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214" returned: 0 in 0.504s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:17 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214 is being set with open permissions: ugo+rw
Jul 14 17:55:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:17 devstack sudo[95564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214
Jul 14 17:55:17 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:18 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214" returned: 0 in 0.370s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-aa726a38-7264-469c-a355-647046940d31 tempest-VolumesSnapshotListTestJSON-1470289129 None] Create snapshot completed successfully
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "cinder-de9d1f95-7077-4465-9d95-7aed92d9c214-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-de9d1f95-7077-4465-9d95-7aed92d9c214-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "cinder-quobyte-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "cinder-quobyte-de9d1f95-7077-4465-9d95-7aed92d9c214" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-de9d1f95-7077-4465-9d95-7aed92d9c214" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Deleting offline snapshot de9d1f95-7077-4465-9d95-7aed92d9c214 of volume fd246cc2-5908-45cf-a9a3-d3dd0df39d53 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] snapshot_file for this snap is: volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d6b96d-06b4-43fa-966d-ba06f3fc8934]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:20 devstack sudo[95570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214
Jul 14 17:55:20 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "cinder-cf530303-1960-475e-9c49-1c296bea4ec6-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Lock "cinder-cf530303-1960-475e-9c49-1c296bea4ec6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:20 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214" returned: 0 in 0.588s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:55:20 devstack sudo[95575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:55:20 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[526591f5-19be-423f-9f87-1747bd52a9e2]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "cinder-quobyte-cf530303-1960-475e-9c49-1c296bea4ec6" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Lock "cinder-quobyte-cf530303-1960-475e-9c49-1c296bea4ec6" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[086331ef-581a-4976-99ab-f24ae7ef403d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:21 devstack sudo[95577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee
Jul 14 17:55:21 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:21 devstack sudo[95578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6
Jul 14 17:55:21 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:21 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.405s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:55:21 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee" returned: 0 in 0.528s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:21 devstack sudo[95588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214
Jul 14 17:55:21 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:21 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6" returned: 0 in 0.537s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:21 devstack sudo[95591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6
Jul 14 17:55:21 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:21 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cf530303-1960-475e-9c49-1c296bea4ec6" returned: 0 in 0.350s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Lock "cinder-quobyte-cf530303-1960-475e-9c49-1c296bea4ec6" released by "delete_volume" :: held 0.940s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Created reservations ['782c3360-b867-438b-8121-7a64b58dde4b', '5ca2f022-a294-4c2a-9e81-a845de4547d0', '1dd02375-2c81-447e-966b-5881addc932b', '039806d0-d539-4156-8167-3580b045a824'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:21 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214" returned: 0 in 0.588s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:22 devstack sudo[95597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214
Jul 14 17:55:22 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:22 devstack sudo[95599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:55:22 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:22 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.de9d1f95-7077-4465-9d95-7aed92d9c214" returned: 0 in 0.454s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-de9d1f95-7077-4465-9d95-7aed92d9c214" released by "_delete_snapshot" :: held 2.306s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" released by "delete_snapshot" :: held 2.352s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:22 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.454s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:55:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Deleted volume successfully.
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dfe2b566-7f43-4e2f-8dce-0a66486e4b10 tempest-AttachVolumeNegativeTest-313902525 None] Lock "cinder-cf530303-1960-475e-9c49-1c296bea4ec6-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "cinder-61a47cca-cf03-4ac4-b642-f256db891961-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Created reservations ['88871e8d-a682-446f-be5b-30ae133ee935', '0a18994f-feff-4c3d-b694-da846f80df4a', 'd705ff45-c126-4e37-98e7-27dd90acac0e', 'a75b9891-2f79-4568-840c-3aaa643e81f9'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Lock "cinder-61a47cca-cf03-4ac4-b642-f256db891961-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "cinder-quobyte-61a47cca-cf03-4ac4-b642-f256db891961" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Lock "cinder-quobyte-61a47cca-cf03-4ac4-b642-f256db891961" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Delete snapshot completed successfully.
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-35134130-1204-4297-9e9d-febfb59ecf7c tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-de9d1f95-7077-4465-9d95-7aed92d9c214-delete_snapshot" released by "delete_snapshot" :: held 2.638s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f474a9-65c1-4a6c-8257-3f59ab81684e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:22 devstack sudo[95603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961
Jul 14 17:55:22 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:23 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961" returned: 0 in 0.389s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:23 devstack sudo[95610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961
Jul 14 17:55:23 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "cinder-0a9c2b83-c653-4ccc-bf13-506c30e8d0ee-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:23 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-61a47cca-cf03-4ac4-b642-f256db891961" returned: 0 in 0.280s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Lock "cinder-quobyte-61a47cca-cf03-4ac4-b642-f256db891961" released by "delete_volume" :: held 0.742s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-0a9c2b83-c653-4ccc-bf13-506c30e8d0ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "cinder-quobyte-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "cinder-quobyte-0a9c2b83-c653-4ccc-bf13-506c30e8d0ee" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-0a9c2b83-c653-4ccc-bf13-506c30e8d0ee" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Deleting offline snapshot 0a9c2b83-c653-4ccc-bf13-506c30e8d0ee of volume fd246cc2-5908-45cf-a9a3-d3dd0df39d53 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] snapshot_file for this snap is: volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Created reservations ['d296c5ec-c13d-4bfd-9a4b-8b770abe22f0', '51007d2d-5bb4-40e9-8330-3ea5cd0f70ed', '80b33cac-d743-4dbd-a45e-865c83a03988', '70782b59-716d-47ad-a75c-271acb306d5f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[362b7ca5-ed4d-4845-a665-57d1d87ada34]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:23 devstack sudo[95614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:55:23 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:23 devstack sudo[95613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee
Jul 14 17:55:23 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:24 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.504s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "cinder-5410c631-9ad6-4593-9ebd-2e8ec8c470b5-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Deleted volume successfully.
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Lock "cinder-5410c631-9ad6-4593-9ebd-2e8ec8c470b5-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d64202a9-99f3-4412-8830-1a2638161373 tempest-AttachVolumeNegativeTest-313902525 None] Lock "cinder-61a47cca-cf03-4ac4-b642-f256db891961-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "cinder-quobyte-5410c631-9ad6-4593-9ebd-2e8ec8c470b5" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Lock "cinder-quobyte-5410c631-9ad6-4593-9ebd-2e8ec8c470b5" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:24 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[446fca9d-1ae4-46d5-a92d-3835e6eaa522]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee" returned: 0 in 0.782s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f267afcf-5978-4dbc-9246-39297ed31c0e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:24 devstack sudo[95621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5
Jul 14 17:55:24 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:24 devstack sudo[95622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea
Jul 14 17:55:24 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:24 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5c3e26ed-01e2-4f37-ab2c-81301744612e tempest-GroupSnapshotsV319Test-1097137945 None] Group tempest-GroupSnapshotsV319Test-Group-1131162405: creating
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5" returned: 0 in 0.453s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:24 devstack sudo[95628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5
Jul 14 17:55:24 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5c3e26ed-01e2-4f37-ab2c-81301744612e tempest-GroupSnapshotsV319Test-1097137945 None] Group tempest-GroupSnapshotsV319Test-Group-1131162405: created successfully
Jul 14 17:55:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5c3e26ed-01e2-4f37-ab2c-81301744612e tempest-GroupSnapshotsV319Test-1097137945 None] Create group completed successfully.
Jul 14 17:55:24 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea" returned: 0 in 0.571s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:55:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:25 devstack sudo[95634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee
Jul 14 17:55:25 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:25 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5410c631-9ad6-4593-9ebd-2e8ec8c470b5" returned: 0 in 0.273s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Lock "cinder-quobyte-5410c631-9ad6-4593-9ebd-2e8ec8c470b5" released by "delete_volume" :: held 0.772s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Created reservations ['9f3211ae-2b70-4637-be1f-9f1c2920fe4c', '38a1f93b-c4f3-4906-9657-a9b37d112e05', '358e9b9f-daf3-400f-9baa-50760d768f69', '830fa391-4570-462e-b712-0e3e01111a7a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:25 devstack sudo[95640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:55:25 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:25 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:25 devstack sudo[95642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee
Jul 14 17:55:25 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:25 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.302s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:55:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Deleted volume successfully.
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c06bcebd-e423-4e51-acd3-2ea99da269c6 tempest-AttachVolumeNegativeTest-313902525 None] Lock "cinder-5410c631-9ad6-4593-9ebd-2e8ec8c470b5-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:25 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.0a9c2b83-c653-4ccc-bf13-506c30e8d0ee" returned: 0 in 0.268s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-0a9c2b83-c653-4ccc-bf13-506c30e8d0ee" released by "_delete_snapshot" :: held 2.116s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" released by "delete_snapshot" :: held 2.156s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Created reservations ['87dd2bb3-9018-4b68-8959-03238c146f34', '841994e7-fca1-4390-85b0-4169e0286ba9', '65b49f86-4a6f-4a28-b139-f896d532a267', '7dd341c7-28ec-4fe5-9617-edad74c101b9'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Delete snapshot completed successfully.
Jul 14 17:55:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab56a237-314a-42d9-87bd-ad750079a1b8 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-0a9c2b83-c653-4ccc-bf13-506c30e8d0ee-delete_snapshot" released by "delete_snapshot" :: held 2.319s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Flow 'volume_create_manager' (1858f4f6-c5b7-4368-9aad-74fede36b633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582a5d0b-c505-42a1-a401-4b6afdc186f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582a5d0b-c505-42a1-a401-4b6afdc186f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-574049098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e4ddbcc6-4bde-4afe-b62c-a87388708319,host='devstack@QuobyteHD#QuobyteHD',id=a2d3627f-8e81-4b2b-9bac-9f836e58f274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8e077a6ac340adb1a54e001a4d6a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:26Z,use_quota=True,user_id='a1ca75b71e3642dab2c4a644cab8ebbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13913d56-26ac-4858-a235-5445a2171449),volume_type_id=13913d56-26ac-4858-a235-5445a2171449)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4032f228-ac48-449a-a95f-a796b6135782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4032f228-ac48-449a-a95f-a796b6135782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793c9144-0315-4285-b0a3-9e1d9a026a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793c9144-0315-4285-b0a3-9e1d9a026a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d3627f-8e81-4b2b-9bac-9f836e58f274', 'volume_name': 'volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944fb375-2a93-409a-ad3e-42f17fdac61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944fb375-2a93-409a-ad3e-42f17fdac61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944629e5-dc4a-4b17-8d7e-dea14264c797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Volume a2d3627f-8e81-4b2b-9bac-9f836e58f274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274', 'volume_size': 1}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e4ddbcc6-4bde-4afe-b62c-a87388708319,created_at=2026-07-14T15:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-574049098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e4ddbcc6-4bde-4afe-b62c-a87388708319,host='devstack@QuobyteHD#QuobyteHD',id=a2d3627f-8e81-4b2b-9bac-9f836e58f274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8e077a6ac340adb1a54e001a4d6a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:26Z,use_quota=True,user_id='a1ca75b71e3642dab2c4a644cab8ebbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13913d56-26ac-4858-a235-5445a2171449),volume_type_id=13913d56-26ac-4858-a235-5445a2171449)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Creating volume a2d3627f-8e81-4b2b-9bac-9f836e58f274 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:55:26 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:26 devstack sudo[95653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274 1073741824
Jul 14 17:55:26 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "cinder-92f85eb3-dedf-4365-8034-cfc50f387eea-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-92f85eb3-dedf-4365-8034-cfc50f387eea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "cinder-quobyte-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "cinder-quobyte-92f85eb3-dedf-4365-8034-cfc50f387eea" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-92f85eb3-dedf-4365-8034-cfc50f387eea" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Deleting offline snapshot 92f85eb3-dedf-4365-8034-cfc50f387eea of volume fd246cc2-5908-45cf-a9a3-d3dd0df39d53 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] snapshot_file for this snap is: volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b689929-f7ec-4a92-8c54-ca85333bb5d7]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:26 devstack sudo[95655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea
Jul 14 17:55:26 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:27 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274 1073741824" returned: 0 in 0.485s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:27 devstack sudo[95662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274
Jul 14 17:55:27 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:27 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea" returned: 0 in 0.437s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[586f0d54-ddf5-4245-a6ab-6f9d818bded1]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:27 devstack sudo[95667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53
Jul 14 17:55:27 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:27 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274" returned: 0 in 0.293s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944629e5-dc4a-4b17-8d7e-dea14264c797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4586b6f-adcd-49aa-b0ed-d8ef5146c3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:27 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Volume volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274 (a2d3627f-8e81-4b2b-9bac-9f836e58f274): created successfully
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4586b6f-adcd-49aa-b0ed-d8ef5146c3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Flow 'volume_create_manager' (1858f4f6-c5b7-4368-9aad-74fede36b633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-257e84e4-c07b-4875-8e3c-86ae9e612aae tempest-GroupSnapshotsV319Test-1097137945 None] Created volume successfully.
Jul 14 17:55:27 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" returned: 0 in 0.389s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:27 devstack sudo[95673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea
Jul 14 17:55:27 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] GroupSnapshot 43b585be-0601-496f-9b37-18735e5471a7: creating.
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] Group snapshot 43b585be-0601-496f-9b37-18735e5471a7: creating. {{(pid=87401) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 14 17:55:28 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea" returned: 0 in 0.389s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] Creating offline snapshot ec790f8f-1d67-425e-833d-0e0810ecc28e of volume a2d3627f-8e81-4b2b-9bac-9f836e58f274 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:55:28 devstack sudo[95678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea
Jul 14 17:55:28 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[10223eb9-9142-4a8f-b96a-55f917faba98]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:28 devstack sudo[95680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274
Jul 14 17:55:28 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:28 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53.92f85eb3-dedf-4365-8034-cfc50f387eea" returned: 0 in 0.286s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-92f85eb3-dedf-4365-8034-cfc50f387eea" released by "_delete_snapshot" :: held 1.620s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" released by "delete_snapshot" :: held 1.655s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Created reservations ['c57f9de3-90b9-4073-86a8-b756ae04a57a', '7b818298-f65b-4472-947a-01dce1df6100', '7738ea60-4ef3-4390-8759-dce2b71e65ce', '68814591-2165-4378-954a-97c09483355b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Delete snapshot completed successfully.
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4dd61ae4-f5a7-42c9-8530-70d38014bb79 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-92f85eb3-dedf-4365-8034-cfc50f387eea-delete_snapshot" released by "delete_snapshot" :: held 1.862s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:28 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274" returned: 0 in 0.456s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:28 devstack sudo[95686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e 1G
Jul 14 17:55:28 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "cinder-fd246cc2-5908-45cf-a9a3-d3dd0df39d53-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-fd246cc2-5908-45cf-a9a3-d3dd0df39d53-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "cinder-quobyte-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:29 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e 1G" returned: 0 in 0.522s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[137d1666-f453-46d7-be61-9e3c12e4edff]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:29 devstack sudo[95693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e
Jul 14 17:55:29 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:29 devstack sudo[95694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53
Jul 14 17:55:29 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:29 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e" returned: 0 in 0.359s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:29 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:29 devstack sudo[95704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e
Jul 14 17:55:29 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:29 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" returned: 0 in 0.408s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:29 devstack sudo[95706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53
Jul 14 17:55:29 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:29 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:29 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" returned: 0 in 0.299s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-quobyte-fd246cc2-5908-45cf-a9a3-d3dd0df39d53" released by "delete_volume" :: held 0.790s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:29 devstack sudo[95710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.info
Jul 14 17:55:29 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:29 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Created reservations ['4078c283-3a7d-4847-bb0e-bac61a8f607a', '2dabcf1d-3d66-472d-b42d-8c02c3e58e22', '19fe6b0a-02fc-45f9-af27-e3a328dd6613', '80798b2e-53d4-4875-a5d0-3e35f0624edb'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:30 devstack sudo[95712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:55:30 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:30 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.info" returned: 0 in 0.294s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:30 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:30 devstack sudo[95739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.info
Jul 14 17:55:30 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:30 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.321s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:55:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Deleted volume successfully.
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f59857bf-46e7-4072-89d0-5e64a1e3d598 tempest-VolumesSnapshotListTestJSON-1470289129 None] Lock "cinder-fd246cc2-5908-45cf-a9a3-d3dd0df39d53-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:30 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.info" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-65006965-50ad-4c15-852b-136b8d4d2a3a tempest-GroupSnapshotsV319Test-1097137945 None] group_snapshot 43b585be-0601-496f-9b37-18735e5471a7: created successfully
Jul 14 17:55:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] group_snapshot 43b585be-0601-496f-9b37-18735e5471a7: deleting
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] group_snapshot 43b585be-0601-496f-9b37-18735e5471a7: deleting {{(pid=87401) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Acquiring lock "cinder-quobyte-a2d3627f-8e81-4b2b-9bac-9f836e58f274" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Lock "cinder-quobyte-a2d3627f-8e81-4b2b-9bac-9f836e58f274" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Acquiring lock "cinder-quobyte-ec790f8f-1d67-425e-833d-0e0810ecc28e" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Lock "cinder-quobyte-ec790f8f-1d67-425e-833d-0e0810ecc28e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Deleting offline snapshot ec790f8f-1d67-425e-833d-0e0810ecc28e of volume a2d3627f-8e81-4b2b-9bac-9f836e58f274 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] snapshot_file for this snap is: volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e82605-d432-4afd-8c39-d1d8b4dd2fe1]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:32 devstack sudo[95743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e
Jul 14 17:55:32 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:32 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e" returned: 0 in 0.435s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca19c4be-2130-4cb5-a937-9e43bb37d986]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:32 devstack sudo[95748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274
Jul 14 17:55:32 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:33 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274" returned: 0 in 0.473s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:33 devstack sudo[95753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e
Jul 14 17:55:33 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Flow 'volume_create_manager' (82ca2ffb-0dad-438e-9517-fa4c1e294d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e4601f-ffbb-4d6d-a859-ecff7f950869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e4601f-ffbb-4d6d-a859-ecff7f950869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1682560285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c68ff3-51e8-406e-ac60-039ec3d299ea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='711522b1c3234816845da21ebbf955d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:33Z,use_quota=True,user_id='92d7b6167cdb4f258ca6c9c4de51e6eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77987023-19e7-438c-bcd6-023de41fdba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77987023-19e7-438c-bcd6-023de41fdba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:33 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3f5f38-0daf-4396-b1cc-dbde68fca0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3f5f38-0daf-4396-b1cc-dbde68fca0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82c68ff3-51e8-406e-ac60-039ec3d299ea', 'volume_name': 'volume-82c68ff3-51e8-406e-ac60-039ec3d299ea', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521c04cd-0277-4281-8422-8c39975a1a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521c04cd-0277-4281-8422-8c39975a1a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54083908-badb-4e05-92f1-0964740d1acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Volume 82c68ff3-51e8-406e-ac60-039ec3d299ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82c68ff3-51e8-406e-ac60-039ec3d299ea', 'volume_size': 1}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1682560285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c68ff3-51e8-406e-ac60-039ec3d299ea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='711522b1c3234816845da21ebbf955d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:33Z,use_quota=True,user_id='92d7b6167cdb4f258ca6c9c4de51e6eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Creating volume 82c68ff3-51e8-406e-ac60-039ec3d299ea {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:55:33 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-82c68ff3-51e8-406e-ac60-039ec3d299ea 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e" returned: 0 in 0.553s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:33 devstack sudo[95760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-82c68ff3-51e8-406e-ac60-039ec3d299ea 1073741824
Jul 14 17:55:33 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:33 devstack sudo[95761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e
Jul 14 17:55:33 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:33 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274.ec790f8f-1d67-425e-833d-0e0810ecc28e" returned: 0 in 0.327s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Lock "cinder-quobyte-ec790f8f-1d67-425e-833d-0e0810ecc28e" released by "_delete_snapshot" :: held 1.930s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Lock "cinder-quobyte-a2d3627f-8e81-4b2b-9bac-9f836e58f274" released by "delete_snapshot" :: held 1.957s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:34 devstack cinder-volume[87401]: WARNING cinder.quota [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-924319362 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-924319362, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:55:34 devstack cinder-volume[87401]: WARNING cinder.quota [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-924319362 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-924319362, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] Created reservations ['1f9ede7c-3be6-44ea-96c3-19fffa4f2e6f', '0adc63ee-88cd-4cbb-bde8-2e91a29dac84', '5e8ca0d7-054a-4254-b5d8-54ad6ae96849', '5e319fb9-92c8-488d-b739-5850068009be'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:34 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-82c68ff3-51e8-406e-ac60-039ec3d299ea 1073741824" returned: 0 in 0.613s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5ed9cd4b-12cf-453c-96ea-f381ec043457 tempest-GroupSnapshotsV319Test-1097137945 None] group_snapshot 43b585be-0601-496f-9b37-18735e5471a7: deleted successfully
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-82c68ff3-51e8-406e-ac60-039ec3d299ea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:34 devstack sudo[95769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-82c68ff3-51e8-406e-ac60-039ec3d299ea
Jul 14 17:55:34 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:34 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-82c68ff3-51e8-406e-ac60-039ec3d299ea" returned: 0 in 0.312s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54083908-badb-4e05-92f1-0964740d1acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c68ff3-51e8-406e-ac60-039ec3d299ea', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04039a3-d634-4aad-a313-a88373642cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:34 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Volume volume-82c68ff3-51e8-406e-ac60-039ec3d299ea (82c68ff3-51e8-406e-ac60-039ec3d299ea): created successfully
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04039a3-d634-4aad-a313-a88373642cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Flow 'volume_create_manager' (82ca2ffb-0dad-438e-9517-fa4c1e294d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-d07f5ca4-e45c-440a-ad9f-7d439f026cc8 req-19f7ee0f-3159-4ac6-94a8-6ba7b405475f tempest-VolumesGetTestJSON-348449025 None] Created volume successfully.
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Acquiring lock "cinder-quobyte-a2d3627f-8e81-4b2b-9bac-9f836e58f274" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Lock "cinder-quobyte-a2d3627f-8e81-4b2b-9bac-9f836e58f274" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[54173bb2-e3a9-41b5-9582-9078a33ef681]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:34 devstack sudo[95806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274
Jul 14 17:55:34 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:35 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274" returned: 0 in 0.449s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:35 devstack sudo[95816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274
Jul 14 17:55:35 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:35 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a2d3627f-8e81-4b2b-9bac-9f836e58f274" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Lock "cinder-quobyte-a2d3627f-8e81-4b2b-9bac-9f836e58f274" released by "delete_volume" :: held 0.818s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:35 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Created reservations ['0fe52378-51f5-4b16-9732-5b094467c26a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:35 devstack cinder-volume[87401]: WARNING cinder.quota [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-924319362 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-924319362, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:55:35 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Created reservations ['2f5fe06d-9715-4d7f-9435-7b47da4c5bad', 'bc38b3d4-6ca3-43c2-85ab-9a253e8bd6af', '87479906-bdcf-4caa-ad08-007a6699c33c', '35592808-5a2c-4f73-b6b9-712c8c032d35'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-0ae1828c-6369-4590-94dd-c35b6f87d16c req-1aa31e21-a0e3-4144-8c8b-7ca9adb7baaf tempest-AttachVolumeTestJSON-2039261099 None] Terminate volume connection completed successfully.
Jul 14 17:55:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-0ae1828c-6369-4590-94dd-c35b6f87d16c req-1aa31e21-a0e3-4144-8c8b-7ca9adb7baaf tempest-AttachVolumeTestJSON-2039261099 None] Deleting attachment 2a143141-fba7-4af0-af42-4b43c6f5f7d8. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:36 devstack sudo[95822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:55:36 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Acquiring lock "cinder-82c68ff3-51e8-406e-ac60-039ec3d299ea-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Lock "cinder-82c68ff3-51e8-406e-ac60-039ec3d299ea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Acquiring lock "cinder-quobyte-82c68ff3-51e8-406e-ac60-039ec3d299ea" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Lock "cinder-quobyte-82c68ff3-51e8-406e-ac60-039ec3d299ea" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafbc58f-6010-4190-8f01-fe18990a1215]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-82c68ff3-51e8-406e-ac60-039ec3d299ea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:36 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:55:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e0560acf-f254-499e-88c4-3911fd69dd1b tempest-GroupSnapshotsV319Test-1097137945 None] Delete group completed successfully.
Jul 14 17:55:36 devstack sudo[95824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-82c68ff3-51e8-406e-ac60-039ec3d299ea
Jul 14 17:55:36 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:36 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-82c68ff3-51e8-406e-ac60-039ec3d299ea" returned: 0 in 0.452s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-82c68ff3-51e8-406e-ac60-039ec3d299ea {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:36 devstack sudo[95831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-82c68ff3-51e8-406e-ac60-039ec3d299ea
Jul 14 17:55:36 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:37 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-82c68ff3-51e8-406e-ac60-039ec3d299ea" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Lock "cinder-quobyte-82c68ff3-51e8-406e-ac60-039ec3d299ea" released by "delete_volume" :: held 0.830s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:37 devstack cinder-volume[87401]: DEBUG cinder.quota [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Created reservations ['0990ea33-0bb6-4cec-bba3-706a13eb9fb8', '6cf56acd-d322-47ee-a398-5402f0d4e1b3', 'e0d0f6f1-ba23-4b19-8a3f-c2019de96ad8', '519bf447-debe-4ff9-a6ec-84c198ac1486'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:55:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:37 devstack sudo[95838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:55:37 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:37 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.328s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:37 devstack cinder-volume[87401]: DEBUG cinder.manager [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:55:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Deleted volume successfully.
Jul 14 17:55:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-9e5d4ca4-0e86-48f4-b1e9-eb65892a7a06 req-3701994b-f20f-46c4-bae4-836191de850d tempest-VolumesGetTestJSON-348449025 None] Lock "cinder-82c68ff3-51e8-406e-ac60-039ec3d299ea-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:55:45 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=137,cinder:UPDATE=158,cinder:DELETE=12,cinder:INSERT=42 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:55:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6db3e84c-fd78-4046-9c44-25cc32f7f6cd tempest-GroupSnapshotsTest-210589130 None] Group tempest-GroupSnapshotsTest-Group-1123730019: creating
Jul 14 17:55:45 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=166,cinder:SELECT=136,cinder:INSERT=37,cinder:DELETE=11 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:55:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6db3e84c-fd78-4046-9c44-25cc32f7f6cd tempest-GroupSnapshotsTest-210589130 None] Group tempest-GroupSnapshotsTest-Group-1123730019: created successfully
Jul 14 17:55:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6db3e84c-fd78-4046-9c44-25cc32f7f6cd tempest-GroupSnapshotsTest-210589130 None] Create group completed successfully.
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Flow 'volume_create_manager' (b2bdc3f9-bd3a-4f20-be42-5bc3306291dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edd0e2f-fa82-4f41-a529-72050bd70d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edd0e2f-fa82-4f41-a529-72050bd70d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-349058168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c6d75531-c9ee-4027-b6c3-352c6822a01d,host='devstack@QuobyteHD#QuobyteHD',id=006b4ac4-f5ac-493b-bf8e-e189e7a5b80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b535ddf67e4026abe0af44ba123ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:48Z,use_quota=True,user_id='283b67a5260f4052b72e62c39126ac37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ffe8525-a2f9-4aa2-abc3-09c711ea4373),volume_type_id=8ffe8525-a2f9-4aa2-abc3-09c711ea4373)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77f5489-f043-4e32-be63-c998a3a8fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77f5489-f043-4e32-be63-c998a3a8fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898fbaff-bef6-4149-baa6-894fa96bbee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (898fbaff-bef6-4149-baa6-894fa96bbee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '006b4ac4-f5ac-493b-bf8e-e189e7a5b80e', 'volume_name': 'volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5c60a5-2bb0-4072-bd54-3349f9134c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5c60a5-2bb0-4072-bd54-3349f9134c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3f3066-0c96-4239-bda4-9385ffd41a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:47 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Volume 006b4ac4-f5ac-493b-bf8e-e189e7a5b80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e', 'volume_size': 1}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c6d75531-c9ee-4027-b6c3-352c6822a01d,created_at=2026-07-14T15:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-349058168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c6d75531-c9ee-4027-b6c3-352c6822a01d,host='devstack@QuobyteHD#QuobyteHD',id=006b4ac4-f5ac-493b-bf8e-e189e7a5b80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b535ddf67e4026abe0af44ba123ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:55:48Z,use_quota=True,user_id='283b67a5260f4052b72e62c39126ac37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ffe8525-a2f9-4aa2-abc3-09c711ea4373),volume_type_id=8ffe8525-a2f9-4aa2-abc3-09c711ea4373)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Creating volume 006b4ac4-f5ac-493b-bf8e-e189e7a5b80e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:55:47 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:55:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:47 devstack sudo[95951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e 1073741824
Jul 14 17:55:47 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:48 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e 1073741824" returned: 0 in 0.839s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:48 devstack sudo[95958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e
Jul 14 17:55:48 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:49 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" returned: 0 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:55:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3f3066-0c96-4239-bda4-9385ffd41a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14de456-ce12-4fca-981c-d6530094ab73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:55:49 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Volume volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e (006b4ac4-f5ac-493b-bf8e-e189e7a5b80e): created successfully
Jul 14 17:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14de456-ce12-4fca-981c-d6530094ab73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:55:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Flow 'volume_create_manager' (b2bdc3f9-bd3a-4f20-be42-5bc3306291dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:55:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9694b607-2ab7-45d6-8fd7-113b08c6e709 tempest-GroupSnapshotsTest-210589130 None] Created volume successfully.
Jul 14 17:55:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] GroupSnapshot 94d661e5-3160-4e1a-a709-208e35a22d29: creating.
Jul 14 17:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] Group snapshot 94d661e5-3160-4e1a-a709-208e35a22d29: creating. {{(pid=87401) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 14 17:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] Creating offline snapshot 3f200422-14fe-4ed0-9535-95b400b9d4a7 of volume 006b4ac4-f5ac-493b-bf8e-e189e7a5b80e {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:55:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bed1ecc-6db4-4108-af23-d197f65a5972]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:50 devstack sudo[95962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e
Jul 14 17:55:50 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:51 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" returned: 0 in 0.504s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:51 devstack sudo[95968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7 1G
Jul 14 17:55:51 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:51 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7 1G" returned: 0 in 0.660s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:51 devstack sudo[95974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7
Jul 14 17:55:51 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:52 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7" returned: 0 in 0.334s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:52 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7 is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:55:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:52 devstack sudo[95979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7
Jul 14 17:55:52 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:52 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:52 devstack sudo[95982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.info
Jul 14 17:55:52 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:53 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.info" returned: 0 in 0.578s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:53 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:53 devstack sudo[95985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.info
Jul 14 17:55:53 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:53 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.info" returned: 0 in 0.456s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.969s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-12b9be21-130f-4fb5-b24e-7873cb80b253 tempest-GroupSnapshotsTest-210589130 None] group_snapshot 94d661e5-3160-4e1a-a709-208e35a22d29: created successfully
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-3f200422-14fe-4ed0-9535-95b400b9d4a7-79c52e07-f110-4475-8bcb-0b320fbee71a" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-3f200422-14fe-4ed0-9535-95b400b9d4a7-79c52e07-f110-4475-8bcb-0b320fbee71a" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Creating volume 79c52e07-f110-4475-8bcb-0b320fbee71a from snapshot 3f200422-14fe-4ed0-9535-95b400b9d4a7 {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-79c52e07-f110-4475-8bcb-0b320fbee71a" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-79c52e07-f110-4475-8bcb-0b320fbee71a" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] snapshot: 3f200422-14fe-4ed0-9535-95b400b9d4a7, volume: 79c52e07-f110-4475-8bcb-0b320fbee71a,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef18f922-5e28-44cc-a9ab-1e38f694bde6]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:55 devstack sudo[95994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7
Jul 14 17:55:55 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:55 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7" returned: 0 in 0.717s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:55:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 17:55:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 17:55:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bcd82f-22a2-47a3-bff8-f28a99ba24c4]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:55:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:55 devstack sudo[95999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e
Jul 14 17:55:55 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:55:56 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root
Jul 14 17:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" returned: 0 in 0.512s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:55:56 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Path /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 17:55:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:55:56 devstack sudo[96005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a
Jul 14 17:55:56 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:02 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a" returned: 0 in 6.328s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff4a960-d5a3-432d-a6be-f799e0608f42]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:02 devstack sudo[96026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e
Jul 14 17:56:02 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:03 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" returned: 0 in 0.741s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:03 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 17:56:03 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Converted 1024.00 MB image at 161.79 MB/s
Jul 14 17:56:03 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:56:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:03 devstack sudo[96031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a
Jul 14 17:56:03 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:03 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a" returned: 0 in 0.283s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-79c52e07-f110-4475-8bcb-0b320fbee71a" released by "_copy_volume_from_snapshot" :: held 8.760s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-3f200422-14fe-4ed0-9535-95b400b9d4a7-79c52e07-f110-4475-8bcb-0b320fbee71a" released by "_create_volume_from_snapshot" :: held 8.818s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.849s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-41791816-e469-48b3-bc9a-2cd617478bfe tempest-GroupSnapshotsTest-210589130 None] Create group from source-snapshot-94d661e5-3160-4e1a-a709-208e35a22d29 completed successfully.
Jul 14 17:56:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-79c52e07-f110-4475-8bcb-0b320fbee71a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-79c52e07-f110-4475-8bcb-0b320fbee71a" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9688371b-9071-4e78-915b-23583f1c5930]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:05 devstack sudo[96035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a
Jul 14 17:56:05 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:05 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a" returned: 0 in 0.514s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:06 devstack sudo[96040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a
Jul 14 17:56:06 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Flow 'volume_create_manager' (32971b9a-b8dc-4e91-9264-b329a7ea79b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249c49b6-541f-4ff5-bca9-1491e3f8e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249c49b6-541f-4ff5-bca9-1491e3f8e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1480102176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92f9311-7631-487a-9269-67c8d09349fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beeb0b3b895c4108837b436f71985625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:06Z,use_quota=True,user_id='19b643a6e66a46cda0687b9d6dc572a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8fffab-2e5f-4f5b-a4db-6332d0ef94aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8fffab-2e5f-4f5b-a4db-6332d0ef94aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff10e1c-b195-4355-833e-305e42ce3260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff10e1c-b195-4355-833e-305e42ce3260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92f9311-7631-487a-9269-67c8d09349fe', 'volume_name': 'volume-a92f9311-7631-487a-9269-67c8d09349fe', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7b6860-7165-4711-b249-6db3e2d9c5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7b6860-7165-4711-b249-6db3e2d9c5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9c356f-57da-41a8-872f-16d5a2af0cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Volume a92f9311-7631-487a-9269-67c8d09349fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92f9311-7631-487a-9269-67c8d09349fe', 'volume_size': 1}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1480102176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92f9311-7631-487a-9269-67c8d09349fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='beeb0b3b895c4108837b436f71985625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:06Z,use_quota=True,user_id='19b643a6e66a46cda0687b9d6dc572a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Creating volume a92f9311-7631-487a-9269-67c8d09349fe {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:56:06 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a92f9311-7631-487a-9269-67c8d09349fe 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:06 devstack sudo[96042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a92f9311-7631-487a-9269-67c8d09349fe 1073741824
Jul 14 17:56:06 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:06 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-79c52e07-f110-4475-8bcb-0b320fbee71a" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-79c52e07-f110-4475-8bcb-0b320fbee71a" released by "delete_volume" :: held 0.912s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Created reservations ['11dcd24f-2546-4d2d-8323-b21dcf319be1'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:06 devstack cinder-volume[87401]: WARNING cinder.quota [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-460157116 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-460157116, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:06 devstack cinder-volume[87401]: WARNING cinder.quota [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-460157116 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-460157116, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Created reservations ['30c197f2-3130-43f1-b449-dc3cf6bde9db', 'a162d60f-3f08-44b8-bc1d-0d3ceb18d063', 'c151539d-f4b0-4b85-9faa-b3ea7c3d38b3', 'ab5b7178-7017-4504-b429-7dc4b14a11f3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:06 devstack sudo[96048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:56:06 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:06 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a92f9311-7631-487a-9269-67c8d09349fe 1073741824" returned: 0 in 0.643s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a92f9311-7631-487a-9269-67c8d09349fe {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:06 devstack sudo[96052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a92f9311-7631-487a-9269-67c8d09349fe
Jul 14 17:56:06 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:06 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.289s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:06 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:56:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-952d99e0-16e0-437f-beab-4a12923aaabd tempest-GroupSnapshotsTest-210589130 None] Delete group completed successfully.
Jul 14 17:56:07 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a92f9311-7631-487a-9269-67c8d09349fe" returned: 0 in 0.306s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9c356f-57da-41a8-872f-16d5a2af0cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92f9311-7631-487a-9269-67c8d09349fe', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0df392-3ffa-4a1b-abcb-2cc529928f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:07 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Volume volume-a92f9311-7631-487a-9269-67c8d09349fe (a92f9311-7631-487a-9269-67c8d09349fe): created successfully
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0df392-3ffa-4a1b-abcb-2cc529928f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Flow 'volume_create_manager' (32971b9a-b8dc-4e91-9264-b329a7ea79b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e8ae6d5a-e59a-4ece-bdfa-ee7e310f2271 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Created volume successfully.
Jul 14 17:56:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] group_snapshot 94d661e5-3160-4e1a-a709-208e35a22d29: deleting
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] group_snapshot 94d661e5-3160-4e1a-a709-208e35a22d29: deleting {{(pid=87401) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-3f200422-14fe-4ed0-9535-95b400b9d4a7" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-3f200422-14fe-4ed0-9535-95b400b9d4a7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Deleting offline snapshot 3f200422-14fe-4ed0-9535-95b400b9d4a7 of volume 006b4ac4-f5ac-493b-bf8e-e189e7a5b80e {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:56:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] snapshot_file for this snap is: volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:56:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce35502-fa7e-4967-98cc-9a8982903384]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:08 devstack sudo[96072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7
Jul 14 17:56:08 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:08 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7" returned: 0 in 0.679s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:56:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a972729d-d080-4a2e-8e4e-717acd4dcc9c]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:08 devstack sudo[96091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e
Jul 14 17:56:08 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:09 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" returned: 0 in 0.610s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:09 devstack sudo[96098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7
Jul 14 17:56:09 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Acquiring lock "cinder-a92f9311-7631-487a-9269-67c8d09349fe-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Lock "cinder-a92f9311-7631-487a-9269-67c8d09349fe-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:10 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Acquiring lock "cinder-quobyte-a92f9311-7631-487a-9269-67c8d09349fe" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7" returned: 0 in 0.664s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Lock "cinder-quobyte-a92f9311-7631-487a-9269-67c8d09349fe" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:10 devstack sudo[96114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7
Jul 14 17:56:10 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36f6f43-d7e6-4320-89fc-ab869746ab5c]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a92f9311-7631-487a-9269-67c8d09349fe {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:10 devstack sudo[96119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a92f9311-7631-487a-9269-67c8d09349fe
Jul 14 17:56:10 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:10 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e.3f200422-14fe-4ed0-9535-95b400b9d4a7" returned: 0 in 0.605s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-3f200422-14fe-4ed0-9535-95b400b9d4a7" released by "_delete_snapshot" :: held 2.740s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" released by "delete_snapshot" :: held 2.776s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:10 devstack cinder-volume[87401]: WARNING cinder.quota [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-460157116 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-460157116, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:10 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:10 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] Created reservations ['ee5782a7-90dd-45e8-b7d3-6f0d1bbd5d26', '72a535b8-29fc-4d8e-9815-f9269798a42d', 'd8ef6e38-63a1-436f-9fde-6d2b626f4c4e', 'f498f264-6949-40c6-a178-1d37fee66554'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a92f9311-7631-487a-9269-67c8d09349fe" returned: 0 in 0.742s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a92f9311-7631-487a-9269-67c8d09349fe {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:10 devstack sudo[96129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a92f9311-7631-487a-9269-67c8d09349fe
Jul 14 17:56:10 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d10c28bc-70ce-4afa-a91e-f60bf0f5ddda tempest-GroupSnapshotsTest-210589130 None] group_snapshot 94d661e5-3160-4e1a-a709-208e35a22d29: deleted successfully
Jul 14 17:56:11 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a92f9311-7631-487a-9269-67c8d09349fe" returned: 0 in 0.322s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Lock "cinder-quobyte-a92f9311-7631-487a-9269-67c8d09349fe" released by "delete_volume" :: held 1.134s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Created reservations ['6a67d6c2-31c1-4641-8aec-a4aae13ed816', 'db577f57-b6b5-4adb-807c-d11b1bd15e88', '71bc85f5-1704-4970-8b24-ffb4463707e5', '290c2296-a778-4171-b33a-b48310f3cbe1'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:11 devstack sudo[96133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:56:11 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:11 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.254s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:56:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Deleted volume successfully.
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b089dc94-2da1-43ac-809c-fabe104820e7 tempest-VolumeQuotasNegativeTestJSON-335125000 None] Lock "cinder-a92f9311-7631-487a-9269-67c8d09349fe-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" acquired by "delete_volume" :: waited 0.045s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bac9d5c-dcec-4ced-af2b-57f95073f951]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:12 devstack sudo[96137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e
Jul 14 17:56:12 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:12 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" returned: 0 in 0.478s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:12 devstack sudo[96142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e
Jul 14 17:56:12 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:12 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" returned: 0 in 0.521s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-006b4ac4-f5ac-493b-bf8e-e189e7a5b80e" released by "delete_volume" :: held 1.137s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:13 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Created reservations ['ac5c0364-0af7-4e40-b768-7ae8ff9f3664'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:13 devstack cinder-volume[87401]: WARNING cinder.db.api [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-460157116']
Jul 14 17:56:13 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Created reservations ['a970356f-7304-4034-9697-1a365548758b', 'f1b93147-4b75-41a0-a8f7-e34b0240f160', 'db826e10-8258-4eca-bf06-40faf46bd39c', '1003280e-e485-4c3b-8a82-051f5d26fd13'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:13 devstack sudo[96200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:56:13 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:13 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.460s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:13 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:56:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fa310a5a-66e7-4fb4-b82f-259522a8ee39 tempest-GroupSnapshotsTest-210589130 None] Delete group completed successfully.
Jul 14 17:56:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3e2e2ab2-a212-4c8c-8b86-035fc2c6625c tempest-GroupSnapshotsTest-210589130 None] Group tempest-GroupSnapshotsTest-Group-1353700196: creating
Jul 14 17:56:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3e2e2ab2-a212-4c8c-8b86-035fc2c6625c tempest-GroupSnapshotsTest-210589130 None] Group tempest-GroupSnapshotsTest-Group-1353700196: created successfully
Jul 14 17:56:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3e2e2ab2-a212-4c8c-8b86-035fc2c6625c tempest-GroupSnapshotsTest-210589130 None] Create group completed successfully.
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Flow 'volume_create_manager' (7d608789-2d30-449f-b8f3-c64baf4f1b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e084fc91-72bd-4c74-8739-4a6acdfaf0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e084fc91-72bd-4c74-8739-4a6acdfaf0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-815825205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f53fb3d7-826a-4ced-915f-c99156734867,host='devstack@QuobyteHD#QuobyteHD',id=962c2d20-66f9-499b-bede-0965ba47a1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b535ddf67e4026abe0af44ba123ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:17Z,use_quota=True,user_id='283b67a5260f4052b72e62c39126ac37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f17a41db-86aa-491f-aa8d-ac5155b6289a),volume_type_id=f17a41db-86aa-491f-aa8d-ac5155b6289a)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b90e35-5c3d-4dbc-85fb-783298de32b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b90e35-5c3d-4dbc-85fb-783298de32b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72cc368-e8f4-45a0-b2e0-27c205352669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72cc368-e8f4-45a0-b2e0-27c205352669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '962c2d20-66f9-499b-bede-0965ba47a1a0', 'volume_name': 'volume-962c2d20-66f9-499b-bede-0965ba47a1a0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b179c85-31bc-4740-bb3c-bec79ffd2fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b179c85-31bc-4740-bb3c-bec79ffd2fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b35df9-ae1f-4b6d-a585-1abe7ecc1351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Volume 962c2d20-66f9-499b-bede-0965ba47a1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-962c2d20-66f9-499b-bede-0965ba47a1a0', 'volume_size': 1}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f53fb3d7-826a-4ced-915f-c99156734867,created_at=2026-07-14T15:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-815825205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f53fb3d7-826a-4ced-915f-c99156734867,host='devstack@QuobyteHD#QuobyteHD',id=962c2d20-66f9-499b-bede-0965ba47a1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b535ddf67e4026abe0af44ba123ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:17Z,use_quota=True,user_id='283b67a5260f4052b72e62c39126ac37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f17a41db-86aa-491f-aa8d-ac5155b6289a),volume_type_id=f17a41db-86aa-491f-aa8d-ac5155b6289a)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Creating volume 962c2d20-66f9-499b-bede-0965ba47a1a0 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:56:17 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:56:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:17 devstack sudo[96221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0 1073741824
Jul 14 17:56:17 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:18 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0 1073741824" returned: 0 in 0.767s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:18 devstack sudo[96227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0
Jul 14 17:56:18 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:18 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0" returned: 0 in 0.576s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:56:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b35df9-ae1f-4b6d-a585-1abe7ecc1351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-962c2d20-66f9-499b-bede-0965ba47a1a0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d531a53e-cd18-429e-88cc-f6358bca67b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Volume volume-962c2d20-66f9-499b-bede-0965ba47a1a0 (962c2d20-66f9-499b-bede-0965ba47a1a0): created successfully
Jul 14 17:56:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d531a53e-cd18-429e-88cc-f6358bca67b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Flow 'volume_create_manager' (7d608789-2d30-449f-b8f3-c64baf4f1b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3a104da7-4ed6-4401-beaf-0f066d8223cd tempest-GroupSnapshotsTest-210589130 None] Created volume successfully.
Jul 14 17:56:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:56:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:20 devstack sudo[96237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:56:20 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:21 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Flow 'volume_create_manager' (e01ddcf9-5b12-414b-8a1d-63922c4abaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f44706c-a171-4b6d-908f-4791066e9bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f44706c-a171-4b6d-908f-4791066e9bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-896201243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f53fb3d7-826a-4ced-915f-c99156734867,host='devstack@QuobyteHD#QuobyteHD',id=c29d0334-54fe-46bc-a1c8-9956f0845bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b535ddf67e4026abe0af44ba123ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:21Z,use_quota=True,user_id='283b67a5260f4052b72e62c39126ac37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f17a41db-86aa-491f-aa8d-ac5155b6289a),volume_type_id=f17a41db-86aa-491f-aa8d-ac5155b6289a)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e904116-1c3d-4860-a0fa-fe60e76ca4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e904116-1c3d-4860-a0fa-fe60e76ca4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bfbb3f-29ed-4c02-9659-6f6f5c114010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bfbb3f-29ed-4c02-9659-6f6f5c114010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29d0334-54fe-46bc-a1c8-9956f0845bae', 'volume_name': 'volume-c29d0334-54fe-46bc-a1c8-9956f0845bae', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af7a601-deda-4a6c-a8a1-66b7b81eccf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af7a601-deda-4a6c-a8a1-66b7b81eccf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ef0ea0-825a-4d12-8193-2fbfa9dc7d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Volume c29d0334-54fe-46bc-a1c8-9956f0845bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29d0334-54fe-46bc-a1c8-9956f0845bae', 'volume_size': 1}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f53fb3d7-826a-4ced-915f-c99156734867,created_at=2026-07-14T15:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-896201243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f53fb3d7-826a-4ced-915f-c99156734867,host='devstack@QuobyteHD#QuobyteHD',id=c29d0334-54fe-46bc-a1c8-9956f0845bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b535ddf67e4026abe0af44ba123ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:21Z,use_quota=True,user_id='283b67a5260f4052b72e62c39126ac37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f17a41db-86aa-491f-aa8d-ac5155b6289a),volume_type_id=f17a41db-86aa-491f-aa8d-ac5155b6289a)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Creating volume c29d0334-54fe-46bc-a1c8-9956f0845bae {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:56:21 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:56:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:21 devstack sudo[96254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae 1073741824
Jul 14 17:56:21 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Flow 'volume_create_manager' (9a82da94-c5ee-44c7-9622-60d54ce09001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff4d7df-b84b-46a9-a13d-f9c71a93f272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff4d7df-b84b-46a9-a13d-f9c71a93f272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-288949986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ed9f14-bf8c-4934-92c4-8a8af0030d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2be1a28d674ef9a89dd7c05242a3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:22Z,use_quota=True,user_id='144f833cd2814d368786ef8f2a114078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19ca9916-6b05-466b-9c05-931bc8913d90),volume_type_id=19ca9916-6b05-466b-9c05-931bc8913d90)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18cc508-842b-40b2-b405-482b6b7f28e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18cc508-842b-40b2-b405-482b6b7f28e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5953df76-c7f4-42c4-929c-aedeccf06b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5953df76-c7f4-42c4-929c-aedeccf06b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5ed9f14-bf8c-4934-92c4-8a8af0030d3c', 'volume_name': 'volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fecbc56-8b0f-4e4e-90aa-6bf330538259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fecbc56-8b0f-4e4e-90aa-6bf330538259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a41117-677e-44bb-8bd0-6fa07b97c18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Volume a5ed9f14-bf8c-4934-92c4-8a8af0030d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c', 'volume_size': 1}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:22 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae 1073741824" returned: 0 in 0.692s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:22 devstack sudo[96262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae
Jul 14 17:56:22 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:22 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae" returned: 0 in 0.314s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-288949986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ed9f14-bf8c-4934-92c4-8a8af0030d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2be1a28d674ef9a89dd7c05242a3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:22Z,use_quota=True,user_id='144f833cd2814d368786ef8f2a114078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19ca9916-6b05-466b-9c05-931bc8913d90),volume_type_id=19ca9916-6b05-466b-9c05-931bc8913d90)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Creating volume a5ed9f14-bf8c-4934-92c4-8a8af0030d3c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:56:22 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ef0ea0-825a-4d12-8193-2fbfa9dc7d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29d0334-54fe-46bc-a1c8-9956f0845bae', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:22 devstack sudo[96265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c 1073741824
Jul 14 17:56:22 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019a6f72-0e50-4575-af2a-2c2059bda649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Volume volume-c29d0334-54fe-46bc-a1c8-9956f0845bae (c29d0334-54fe-46bc-a1c8-9956f0845bae): created successfully
Jul 14 17:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019a6f72-0e50-4575-af2a-2c2059bda649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Flow 'volume_create_manager' (e01ddcf9-5b12-414b-8a1d-63922c4abaa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b898b0ec-42ba-478e-a56f-33b1c2661a2c tempest-GroupSnapshotsTest-210589130 None] Created volume successfully.
Jul 14 17:56:23 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c 1073741824" returned: 0 in 0.568s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:23 devstack sudo[96271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c
Jul 14 17:56:23 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:23 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c" returned: 0 in 0.349s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:56:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a41117-677e-44bb-8bd0-6fa07b97c18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc321613-4e9c-4587-81f6-69a34608eb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Volume volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c (a5ed9f14-bf8c-4934-92c4-8a8af0030d3c): created successfully
Jul 14 17:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc321613-4e9c-4587-81f6-69a34608eb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Flow 'volume_create_manager' (9a82da94-c5ee-44c7-9622-60d54ce09001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-96607526-f58f-4a19-bcb5-b0fca615364d tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Created volume successfully.
Jul 14 17:56:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fa2b3146-0626-464b-b649-a80721560b22 tempest-GroupSnapshotsTest-210589130 None] Update group completed successfully.
Jul 14 17:56:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b0d4d35f-fd66-453f-ac22-e0f92de9cbcd tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b0d4d35f-fd66-453f-ac22-e0f92de9cbcd tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b0d4d35f-fd66-453f-ac22-e0f92de9cbcd tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b0d4d35f-fd66-453f-ac22-e0f92de9cbcd tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b0d4d35f-fd66-453f-ac22-e0f92de9cbcd tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0d4d35f-fd66-453f-ac22-e0f92de9cbcd tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:25 devstack sudo[96290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:56:25 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:25 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0d4d35f-fd66-453f-ac22-e0f92de9cbcd tempest-VolumeRetypeWithoutMigrationTest-433621929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.639s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:25 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b0d4d35f-fd66-453f-ac22-e0f92de9cbcd tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:56:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b0d4d35f-fd66-453f-ac22-e0f92de9cbcd tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Retype volume completed successfully.
Jul 14 17:56:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0841b38f-8972-492c-9747-6e16f33d5dd4 tempest-GroupSnapshotsTest-210589130 None] Update group completed successfully.
Jul 14 17:56:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Acquiring lock "cinder-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Lock "cinder-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Acquiring lock "cinder-quobyte-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Lock "cinder-quobyte-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:26 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f244cc7-5e61-48a8-b113-a89db5ab9187]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:26 devstack sudo[96345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c
Jul 14 17:56:26 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:27 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c" returned: 0 in 0.640s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:27 devstack sudo[96352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c
Jul 14 17:56:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4c1d0559-c2f6-441a-9548-65614d33e0a6 tempest-GroupSnapshotsTest-210589130 None] Update group completed successfully.
Jul 14 17:56:27 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:27 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c" returned: 0 in 0.424s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Lock "cinder-quobyte-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c" released by "delete_volume" :: held 1.103s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:27 devstack cinder-volume[87401]: WARNING cinder.quota [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:27 devstack cinder-volume[87401]: WARNING cinder.quota [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:27 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Created reservations ['1aa72482-7533-4062-82c6-ea7ae99802a9', '3dc50a01-f772-4d3c-9643-8d07267548ff', '9e118ba8-0126-4913-a315-f8aeeab7cc5c', '41ddc3e5-28c5-42c9-8d94-5d7fefb1f62b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:27 devstack sudo[96375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:56:27 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:28 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:28 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:56:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Deleted volume successfully.
Jul 14 17:56:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9e6f4ca3-6da4-4d64-a382-e34238f59bfe tempest-VolumeRetypeWithoutMigrationTest-433621929 None] Lock "cinder-a5ed9f14-bf8c-4934-92c4-8a8af0030d3c-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ed3db614-cc58-45ca-86e8-22a3d3d21de6 tempest-GroupSnapshotsTest-210589130 None] Update group completed successfully.
Jul 14 17:56:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] GroupSnapshot 356a9663-9d18-4cc8-827a-1985b4e3c72c: creating.
Jul 14 17:56:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Group snapshot 356a9663-9d18-4cc8-827a-1985b4e3c72c: creating. {{(pid=87401) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 14 17:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Creating offline snapshot 3e68aba5-e14b-47c4-9121-ddf544fe7bb2 of volume c29d0334-54fe-46bc-a1c8-9956f0845bae {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:56:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecbb8f7-64bd-45ba-9c0a-1b4e56880d12]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:30 devstack sudo[96380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae
Jul 14 17:56:30 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:30 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae" returned: 0 in 0.471s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:30 devstack sudo[96386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2 1G
Jul 14 17:56:30 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:31 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2 1G" returned: 0 in 0.470s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29d0334-54fe-46bc-a1c8-9956f0845bae -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:31 devstack sudo[96393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29d0334-54fe-46bc-a1c8-9956f0845bae -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2
Jul 14 17:56:31 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:31 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29d0334-54fe-46bc-a1c8-9956f0845bae -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2" returned: 0 in 0.329s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:31 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2 is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:56:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:31 devstack sudo[96399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2
Jul 14 17:56:31 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:31 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2" returned: 0 in 0.291s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:31 devstack sudo[96402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.info
Jul 14 17:56:31 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:32 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.info" returned: 0 in 0.281s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:32 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:32 devstack sudo[96405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.info
Jul 14 17:56:32 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:32 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.info" returned: 0 in 0.299s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Creating offline snapshot 82ff0d7b-0e8e-4238-a06f-2d344e2f66ff of volume 962c2d20-66f9-499b-bede-0965ba47a1a0 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:56:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b9a29-f64f-497c-8c59-2a67b2af6cff]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:32 devstack sudo[96408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0
Jul 14 17:56:32 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:32 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0" returned: 0 in 0.378s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:32 devstack sudo[96414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff 1G
Jul 14 17:56:32 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:33 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff 1G" returned: 0 in 0.413s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-962c2d20-66f9-499b-bede-0965ba47a1a0 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:33 devstack sudo[96419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-962c2d20-66f9-499b-bede-0965ba47a1a0 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff
Jul 14 17:56:33 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:33 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-962c2d20-66f9-499b-bede-0965ba47a1a0 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:33 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:56:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:33 devstack sudo[96424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff
Jul 14 17:56:33 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:33 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff" returned: 0 in 0.255s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:33 devstack sudo[96427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.info
Jul 14 17:56:33 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:34 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.info" returned: 0 in 0.259s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:34 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:56:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:34 devstack sudo[96430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.info
Jul 14 17:56:34 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:34 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.info" returned: 0 in 0.297s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-dc699192-2e4b-492f-8db5-7dfcf8f30dea tempest-GroupSnapshotsTest-210589130 None] group_snapshot 356a9663-9d18-4cc8-827a-1985b4e3c72c: created successfully
Jul 14 17:56:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] group_snapshot 356a9663-9d18-4cc8-827a-1985b4e3c72c: deleting
Jul 14 17:56:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] group_snapshot 356a9663-9d18-4cc8-827a-1985b4e3c72c: deleting {{(pid=87401) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 14 17:56:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-c29d0334-54fe-46bc-a1c8-9956f0845bae" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-c29d0334-54fe-46bc-a1c8-9956f0845bae" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-3e68aba5-e14b-47c4-9121-ddf544fe7bb2" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-3e68aba5-e14b-47c4-9121-ddf544fe7bb2" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Deleting offline snapshot 3e68aba5-e14b-47c4-9121-ddf544fe7bb2 of volume c29d0334-54fe-46bc-a1c8-9956f0845bae {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:56:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] snapshot_file for this snap is: volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:56:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cae9819-ba9b-472c-8884-56ae5e468ec7]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:36 devstack sudo[96469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2
Jul 14 17:56:36 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:36 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2" returned: 0 in 0.503s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c29d0334-54fe-46bc-a1c8-9956f0845bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:56:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54c8e74-981a-473a-a413-cf7f25909f15]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:36 devstack sudo[96474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae
Jul 14 17:56:36 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:37 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae" returned: 0 in 0.609s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:37 devstack sudo[96479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2
Jul 14 17:56:37 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:37 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2" returned: 0 in 0.367s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:37 devstack sudo[96485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2
Jul 14 17:56:37 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:37 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae.3e68aba5-e14b-47c4-9121-ddf544fe7bb2" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-3e68aba5-e14b-47c4-9121-ddf544fe7bb2" released by "_delete_snapshot" :: held 1.947s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-c29d0334-54fe-46bc-a1c8-9956f0845bae" released by "delete_snapshot" :: held 1.999s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-962c2d20-66f9-499b-bede-0965ba47a1a0" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-962c2d20-66f9-499b-bede-0965ba47a1a0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-82ff0d7b-0e8e-4238-a06f-2d344e2f66ff" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-82ff0d7b-0e8e-4238-a06f-2d344e2f66ff" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Deleting offline snapshot 82ff0d7b-0e8e-4238-a06f-2d344e2f66ff of volume 962c2d20-66f9-499b-bede-0965ba47a1a0 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] snapshot_file for this snap is: volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[993db9e8-73f6-403c-a79c-cbe84ea90718]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:38 devstack sudo[96488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff
Jul 14 17:56:38 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:38 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff" returned: 0 in 0.370s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-962c2d20-66f9-499b-bede-0965ba47a1a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:56:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[511196bf-3324-467f-8c40-2c0850003979]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:38 devstack sudo[96493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0
Jul 14 17:56:38 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:38 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0" returned: 0 in 0.457s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:38 devstack sudo[96500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff
Jul 14 17:56:38 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:39 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff" returned: 0 in 0.405s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:39 devstack sudo[96508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff
Jul 14 17:56:39 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:39 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0.82ff0d7b-0e8e-4238-a06f-2d344e2f66ff" returned: 0 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-82ff0d7b-0e8e-4238-a06f-2d344e2f66ff" released by "_delete_snapshot" :: held 1.717s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-962c2d20-66f9-499b-bede-0965ba47a1a0" released by "delete_snapshot" :: held 1.743s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:39 devstack cinder-volume[87401]: WARNING cinder.quota [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1136874494 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1136874494, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:39 devstack cinder-volume[87401]: WARNING cinder.quota [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1136874494 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1136874494, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:39 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Created reservations ['2e36f392-763a-434c-877e-513aeffd17be', '1c9be3af-595a-4635-be80-c3a2d15c4afa', 'a52c324e-7053-4fb2-8d52-4e9358263cb4', '503b79ce-8318-4dad-9eec-90a84a89e05f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:39 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] Created reservations ['8de7eeeb-0898-4461-a014-91906fd39f0d', '6dcd69eb-4f14-469f-9b7e-1d1cc383772d', 'efa6b8ff-dcad-4d63-9f19-82941d7579f6', '2914a0b3-5b16-468a-b6a6-691904b18fe8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:40 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a736cba4-4e20-458f-9baf-84baea0b6ea0 tempest-GroupSnapshotsTest-210589130 None] group_snapshot 356a9663-9d18-4cc8-827a-1985b4e3c72c: deleted successfully
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Flow 'volume_create_manager' (05045e32-fa08-4eca-a8b7-3482b4d82320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5aef3aa-65a5-477b-bc7c-6bbeabd6c777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5aef3aa-65a5-477b-bc7c-6bbeabd6c777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-726864613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d22aafa-d940-42a4-a159-777c0b11558f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91924f9dee942bba9c53c3548222692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:40Z,use_quota=True,user_id='0c9a20137ab14b368ec8cfa0003f344a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbdd7ca6-495f-4828-9ec6-43dccdb0d933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbdd7ca6-495f-4828-9ec6-43dccdb0d933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201f3d6a-d988-4d30-bedc-d00306327777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201f3d6a-d988-4d30-bedc-d00306327777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d22aafa-d940-42a4-a159-777c0b11558f', 'volume_name': 'volume-6d22aafa-d940-42a4-a159-777c0b11558f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f063aa-d58f-4ce6-8f16-81596383a0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f063aa-d58f-4ce6-8f16-81596383a0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f440b0-72e1-470a-b505-0dc10bd42175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:40 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Volume 6d22aafa-d940-42a4-a159-777c0b11558f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d22aafa-d940-42a4-a159-777c0b11558f', 'volume_size': 1}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-726864613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d22aafa-d940-42a4-a159-777c0b11558f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91924f9dee942bba9c53c3548222692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:40Z,use_quota=True,user_id='0c9a20137ab14b368ec8cfa0003f344a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Creating volume 6d22aafa-d940-42a4-a159-777c0b11558f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:56:40 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:40 devstack sudo[96526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f 1073741824
Jul 14 17:56:40 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:40 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f 1073741824" returned: 0 in 0.498s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:40 devstack sudo[96532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f
Jul 14 17:56:40 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-962c2d20-66f9-499b-bede-0965ba47a1a0" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-962c2d20-66f9-499b-bede-0965ba47a1a0" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03f341f-e5ae-4b78-854f-8847ebdb7cf4]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:41 devstack sudo[96534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0
Jul 14 17:56:41 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:41 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f" returned: 0 in 0.348s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f440b0-72e1-470a-b505-0dc10bd42175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d22aafa-d940-42a4-a159-777c0b11558f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f1eb74-377e-4699-b3da-c6aaede6c7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:41 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Volume volume-6d22aafa-d940-42a4-a159-777c0b11558f (6d22aafa-d940-42a4-a159-777c0b11558f): created successfully
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f1eb74-377e-4699-b3da-c6aaede6c7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Flow 'volume_create_manager' (05045e32-fa08-4eca-a8b7-3482b4d82320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:41 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d4c7f2de-ab16-44b4-b76d-9833ed93a433 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Created volume successfully.
Jul 14 17:56:41 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0" returned: 0 in 0.430s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:41 devstack sudo[96540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0
Jul 14 17:56:41 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:41 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-962c2d20-66f9-499b-bede-0965ba47a1a0" returned: 0 in 0.283s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-962c2d20-66f9-499b-bede-0965ba47a1a0" released by "delete_volume" :: held 0.788s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-c29d0334-54fe-46bc-a1c8-9956f0845bae" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-c29d0334-54fe-46bc-a1c8-9956f0845bae" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe72f866-1bfb-43ef-ad50-af4ec3c01ac0]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Flow 'volume_create_manager' (c3e7bbb0-ef50-468c-9012-68c46bac4b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdce6b49-65f0-46a6-a811-e2ef5e9c2ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdce6b49-65f0-46a6-a811-e2ef5e9c2ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1356618615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec4b239-edb6-4c9e-a9e5-87375a4dd815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b690b49ab6794d6eaa90c40de2c68fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:42Z,use_quota=True,user_id='0c4b9e32bd524173abe1dc01f3c5f0bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfb9d8c3-95d6-4e21-9b7b-369d7206b8e4),volume_type_id=dfb9d8c3-95d6-4e21-9b7b-369d7206b8e4)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fb2c8c-fc5a-4b17-bd56-f3bdf784e063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fb2c8c-fc5a-4b17-bd56-f3bdf784e063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3421ce04-7eab-48a6-95ea-a8428c88da05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3421ce04-7eab-48a6-95ea-a8428c88da05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec4b239-edb6-4c9e-a9e5-87375a4dd815', 'volume_name': 'volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78321c48-c2e8-4347-9bcb-2ceef71eb1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78321c48-c2e8-4347-9bcb-2ceef71eb1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:41 devstack sudo[96543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae
Jul 14 17:56:41 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b50dc8a-ee57-4122-9d45-d38bd3bb69a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:41 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Volume 9ec4b239-edb6-4c9e-a9e5-87375a4dd815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815', 'volume_size': 1}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1356618615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec4b239-edb6-4c9e-a9e5-87375a4dd815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b690b49ab6794d6eaa90c40de2c68fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:42Z,use_quota=True,user_id='0c4b9e32bd524173abe1dc01f3c5f0bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfb9d8c3-95d6-4e21-9b7b-369d7206b8e4),volume_type_id=dfb9d8c3-95d6-4e21-9b7b-369d7206b8e4)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Creating volume 9ec4b239-edb6-4c9e-a9e5-87375a4dd815 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:56:41 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:56:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:41 devstack sudo[96545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815 1073741824
Jul 14 17:56:41 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:42 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae" returned: 0 in 0.459s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:42 devstack sudo[96554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae
Jul 14 17:56:42 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:42 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815 1073741824" returned: 0 in 0.546s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:42 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c29d0334-54fe-46bc-a1c8-9956f0845bae" returned: 0 in 0.297s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:42 devstack sudo[96561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815
Jul 14 17:56:42 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-c29d0334-54fe-46bc-a1c8-9956f0845bae" released by "delete_volume" :: held 0.821s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Created reservations ['9c2aaf0c-7e46-4733-b1a9-3a64a1829c47'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:42 devstack cinder-volume[87401]: WARNING cinder.quota [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1136874494 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1136874494, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Created reservations ['00352bd8-f0b2-45f4-8c38-a18b3b0af1bf', 'b799548d-978a-4033-a03d-0967b1a0dd4a', 'ad1b032a-ea27-452a-847f-ae141fc1e61f', '2734ca18-acd8-496c-90a4-7208d2f160e1'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Created reservations ['e8ac8014-0325-4d64-b3ad-3f7d766567ca', '7294842b-c673-4564-a4b2-6ee611b511e1', '50c5b8a3-476f-4c5f-8ee3-214d39689575', '6011f0a3-04c0-4296-ac07-4c30a7698a2f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:42 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815" returned: 0 in 0.333s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b50dc8a-ee57-4122-9d45-d38bd3bb69a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb9e250-439d-4ffb-9843-68e90f1664a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:42 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Volume volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815 (9ec4b239-edb6-4c9e-a9e5-87375a4dd815): created successfully
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb9e250-439d-4ffb-9843-68e90f1664a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Flow 'volume_create_manager' (c3e7bbb0-ef50-468c-9012-68c46bac4b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cc8556b0-c72c-42f7-8b30-b9c120b688f1 tempest-VolumeTypesAccessTest-231452371 None] Created volume successfully.
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:42 devstack sudo[96571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:56:42 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-52c689d5-0027-4e3f-94c2-b87d2b6d63df req-79009af7-5011-45d4-b2b6-e29857c2ee49 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-52c689d5-0027-4e3f-94c2-b87d2b6d63df req-79009af7-5011-45d4-b2b6-e29857c2ee49 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:43 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa6a12b-e8e7-4b9d-b3e0-1047e0b1b1ed]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-52c689d5-0027-4e3f-94c2-b87d2b6d63df req-79009af7-5011-45d4-b2b6-e29857c2ee49 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:43 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.247s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:43 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:56:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c871a4bb-21f0-4f78-bc6a-2efe16edfc28 tempest-GroupSnapshotsTest-210589130 None] Delete group completed successfully.
Jul 14 17:56:43 devstack sudo[96574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f
Jul 14 17:56:43 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:43 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-52c689d5-0027-4e3f-94c2-b87d2b6d63df req-79009af7-5011-45d4-b2b6-e29857c2ee49 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f" returned: 0 in 0.413s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-52c689d5-0027-4e3f-94c2-b87d2b6d63df req-79009af7-5011-45d4-b2b6-e29857c2ee49 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.432s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-52c689d5-0027-4e3f-94c2-b87d2b6d63df req-79009af7-5011-45d4-b2b6-e29857c2ee49 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-6d22aafa-d940-42a4-a159-777c0b11558f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04fa06ad-7ab1-4bad-b461-c0cb7a6230ae', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:56:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-52c689d5-0027-4e3f-94c2-b87d2b6d63df req-79009af7-5011-45d4-b2b6-e29857c2ee49 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] attachment_update completed successfully.
Jul 14 17:56:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-20e5e1fd-33a7-4a8c-b3af-36bad0b8d63d tempest-GroupSnapshotsTest-210589130 None] Group tempest-GroupSnapshotsTest-Group-1838253676: creating
Jul 14 17:56:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-20e5e1fd-33a7-4a8c-b3af-36bad0b8d63d tempest-GroupSnapshotsTest-210589130 None] Group tempest-GroupSnapshotsTest-Group-1838253676: created successfully
Jul 14 17:56:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-20e5e1fd-33a7-4a8c-b3af-36bad0b8d63d tempest-GroupSnapshotsTest-210589130 None] Create group completed successfully.
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Acquiring lock "cinder-9ec4b239-edb6-4c9e-a9e5-87375a4dd815-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Lock "cinder-9ec4b239-edb6-4c9e-a9e5-87375a4dd815-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Acquiring lock "cinder-quobyte-9ec4b239-edb6-4c9e-a9e5-87375a4dd815" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Lock "cinder-quobyte-9ec4b239-edb6-4c9e-a9e5-87375a4dd815" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9577727-ee1d-45c9-a4ac-b577c666b2cd]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:44 devstack sudo[96981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815
Jul 14 17:56:44 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:44 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815" returned: 0 in 0.407s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:44 devstack sudo[96989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815
Jul 14 17:56:44 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:44 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9ec4b239-edb6-4c9e-a9e5-87375a4dd815" returned: 0 in 0.244s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Lock "cinder-quobyte-9ec4b239-edb6-4c9e-a9e5-87375a4dd815" released by "delete_volume" :: held 0.694s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:44 devstack cinder-volume[87401]: WARNING cinder.quota [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1872325939 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1872325939, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:44 devstack cinder-volume[87401]: WARNING cinder.quota [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1872325939 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1872325939, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Created reservations ['7be2a055-930f-4748-bae8-6a4995a3186e', 'f1d84ebc-f4a0-40d8-a3e0-ba158370e70a', 'af4dbc4a-52d3-4041-99f3-181ed4123f8a', 'ab837fd5-fd09-48e2-8d70-71841dbdeac9'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:45 devstack sudo[96992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:56:45 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:45 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.301s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:56:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Deleted volume successfully.
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fcb817ea-3662-4add-9781-e0e19bf9e4ac tempest-VolumeTypesAccessTest-231452371 None] Lock "cinder-9ec4b239-edb6-4c9e-a9e5-87375a4dd815-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=134,cinder:SELECT=116,cinder:INSERT=29,cinder:DELETE=6 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=114,cinder:SELECT=126,cinder:INSERT=24,cinder:DELETE=4 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Flow 'volume_create_manager' (37bfe764-8429-4af8-a5b6-3b4e912b4dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41ba09d-7ddc-4ddd-8e82-3637badddd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41ba09d-7ddc-4ddd-8e82-3637badddd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1291689242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5be6e89a-de91-4d19-bfe1-9dd8dfcfece2,host='devstack@QuobyteHD#QuobyteHD',id=bf343eda-5756-4e7a-8205-71811ff8632b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b535ddf67e4026abe0af44ba123ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:45Z,use_quota=True,user_id='283b67a5260f4052b72e62c39126ac37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c2e046-fa5a-4031-900e-e588d3f68422),volume_type_id=70c2e046-fa5a-4031-900e-e588d3f68422)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6edbd9-897d-43ca-92de-477f1b67f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6edbd9-897d-43ca-92de-477f1b67f204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1bbe82-bc8b-45e0-8118-454149c9f515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1bbe82-bc8b-45e0-8118-454149c9f515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf343eda-5756-4e7a-8205-71811ff8632b', 'volume_name': 'volume-bf343eda-5756-4e7a-8205-71811ff8632b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9c86fd-7ccb-4516-9870-f554930914eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9c86fd-7ccb-4516-9870-f554930914eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49db05d-7523-4a28-8765-2db60d351286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:45 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Volume bf343eda-5756-4e7a-8205-71811ff8632b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf343eda-5756-4e7a-8205-71811ff8632b', 'volume_size': 1}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5be6e89a-de91-4d19-bfe1-9dd8dfcfece2,created_at=2026-07-14T15:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1291689242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5be6e89a-de91-4d19-bfe1-9dd8dfcfece2,host='devstack@QuobyteHD#QuobyteHD',id=bf343eda-5756-4e7a-8205-71811ff8632b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b535ddf67e4026abe0af44ba123ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:45Z,use_quota=True,user_id='283b67a5260f4052b72e62c39126ac37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70c2e046-fa5a-4031-900e-e588d3f68422),volume_type_id=70c2e046-fa5a-4031-900e-e588d3f68422)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Creating volume bf343eda-5756-4e7a-8205-71811ff8632b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:56:45 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:56:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:45 devstack sudo[96995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b 1073741824
Jul 14 17:56:45 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:46 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b 1073741824" returned: 0 in 0.561s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:46 devstack sudo[97001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b
Jul 14 17:56:46 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:46 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b" returned: 0 in 0.413s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:56:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49db05d-7523-4a28-8765-2db60d351286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf343eda-5756-4e7a-8205-71811ff8632b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a431768-43d4-406c-a966-37700ed967de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:46 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Volume volume-bf343eda-5756-4e7a-8205-71811ff8632b (bf343eda-5756-4e7a-8205-71811ff8632b): created successfully
Jul 14 17:56:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a431768-43d4-406c-a966-37700ed967de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Flow 'volume_create_manager' (37bfe764-8429-4af8-a5b6-3b4e912b4dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-288bfb5c-b81e-4042-aa76-ec3045c861c2 tempest-GroupSnapshotsTest-210589130 None] Created volume successfully.
Jul 14 17:56:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-4ace4c5a-d8c8-4eae-b0e4-1436cda26104 req-cb3896e2-8ddf-4475-a07e-4586adac69f1 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Terminate volume connection completed successfully.
Jul 14 17:56:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-4ace4c5a-d8c8-4eae-b0e4-1436cda26104 req-cb3896e2-8ddf-4475-a07e-4586adac69f1 tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Deleting attachment 04fa06ad-7ab1-4bad-b461-c0cb7a6230ae. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:56:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Acquiring lock "cinder-6d22aafa-d940-42a4-a159-777c0b11558f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Lock "cinder-6d22aafa-d940-42a4-a159-777c0b11558f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Acquiring lock "cinder-quobyte-6d22aafa-d940-42a4-a159-777c0b11558f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Lock "cinder-quobyte-6d22aafa-d940-42a4-a159-777c0b11558f" acquired by "delete_volume" :: waited 0.044s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb89564f-5a3e-4c4b-ad6f-d5e895b507ad]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:48 devstack sudo[97031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f
Jul 14 17:56:48 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] GroupSnapshot d9da4c32-9357-4c50-b495-57cad48385a6: creating.
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] Group snapshot d9da4c32-9357-4c50-b495-57cad48385a6: creating. {{(pid=87401) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] Creating offline snapshot 47f4e0a7-0545-480b-b2bc-29bd395cf3d5 of volume bf343eda-5756-4e7a-8205-71811ff8632b {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fcced7-4114-4699-a465-d9bf2a713755]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:48 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f" returned: 0 in 0.477s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:48 devstack sudo[97037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f
Jul 14 17:56:48 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:48 devstack sudo[97036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b
Jul 14 17:56:48 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:48 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6d22aafa-d940-42a4-a159-777c0b11558f" returned: 0 in 0.324s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Lock "cinder-quobyte-6d22aafa-d940-42a4-a159-777c0b11558f" released by "delete_volume" :: held 0.873s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:48 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b" returned: 0 in 0.384s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:48 devstack sudo[97044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5 1G
Jul 14 17:56:48 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:48 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Created reservations ['438a8e3a-f753-427c-b352-aa66b8ed606c', '37652fb8-151d-47a1-ae07-55bd42a0258c', '86c927c4-6262-46b8-8cbf-c44ed8e7a0b5', 'f28796ab-6de9-42a7-994a-7056ea2d78bc'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:49 devstack sudo[97046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:56:49 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:49 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:56:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Deleted volume successfully.
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f497b323-99c1-4765-96d3-d25eda612f5b tempest-TestServerVolumeAttachScenarioOldVersion-982768737 None] Lock "cinder-6d22aafa-d940-42a4-a159-777c0b11558f-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:49 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5 1G" returned: 0 in 0.478s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf343eda-5756-4e7a-8205-71811ff8632b -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:49 devstack sudo[97054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf343eda-5756-4e7a-8205-71811ff8632b -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5
Jul 14 17:56:49 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:49 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf343eda-5756-4e7a-8205-71811ff8632b -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:49 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5 is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:56:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:49 devstack sudo[97062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5
Jul 14 17:56:49 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:50 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5" returned: 0 in 0.350s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:50 devstack sudo[97065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.info
Jul 14 17:56:50 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:50 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.info" returned: 0 in 0.464s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:50 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:56:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:50 devstack sudo[97069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.info
Jul 14 17:56:50 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:50 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:56:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Flow 'volume_create_manager' (db3388d7-7471-41a0-9bc1-e4152e083c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e17fef-90ab-4c02-af5a-12d6f3005567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e17fef-90ab-4c02-af5a-12d6f3005567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-284709144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640ddccc-f2e3-49cf-9a8b-55333eb35c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59370d7652b844de83ec4a59219e8794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:51Z,use_quota=True,user_id='9b2a315a757b47aca532258c6e86799c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb33d4d9-3bb9-4c5f-8dcd-a23dfe883da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb33d4d9-3bb9-4c5f-8dcd-a23dfe883da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cfa341-cf3c-4436-b793-6d2173f73b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cfa341-cf3c-4436-b793-6d2173f73b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640ddccc-f2e3-49cf-9a8b-55333eb35c5d', 'volume_name': 'volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a04534f-074e-4d8a-938d-bdfbd68f7829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a04534f-074e-4d8a-938d-bdfbd68f7829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0430198a-f4af-4d2b-a5d8-e87222f9a04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:51 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Volume 640ddccc-f2e3-49cf-9a8b-55333eb35c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d', 'volume_size': 1}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:51 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.info" returned: 0 in 0.653s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.829s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.222s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-284709144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640ddccc-f2e3-49cf-9a8b-55333eb35c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59370d7652b844de83ec4a59219e8794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:51Z,use_quota=True,user_id='9b2a315a757b47aca532258c6e86799c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Creating volume 640ddccc-f2e3-49cf-9a8b-55333eb35c5d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:56:51 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:56:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:51 devstack sudo[97093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d 1073741824
Jul 14 17:56:51 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b894fff0-96ba-4065-96c2-2355c37b60b4 tempest-GroupSnapshotsTest-210589130 None] group_snapshot d9da4c32-9357-4c50-b495-57cad48385a6: created successfully
Jul 14 17:56:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] group_snapshot d9da4c32-9357-4c50-b495-57cad48385a6: deleting
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] group_snapshot d9da4c32-9357-4c50-b495-57cad48385a6: deleting {{(pid=87401) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-bf343eda-5756-4e7a-8205-71811ff8632b" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-bf343eda-5756-4e7a-8205-71811ff8632b" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-47f4e0a7-0545-480b-b2bc-29bd395cf3d5" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-47f4e0a7-0545-480b-b2bc-29bd395cf3d5" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:52 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Deleting offline snapshot 47f4e0a7-0545-480b-b2bc-29bd395cf3d5 of volume bf343eda-5756-4e7a-8205-71811ff8632b {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] snapshot_file for this snap is: volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d 1073741824" returned: 0 in 0.933s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[724f423f-1df1-4d42-99ca-1cc96399b5c8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:52 devstack sudo[97101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d
Jul 14 17:56:52 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:52 devstack sudo[97100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5
Jul 14 17:56:52 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:52 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d" returned: 0 in 0.318s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0430198a-f4af-4d2b-a5d8-e87222f9a04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598ab9e7-19b2-40ce-b72e-e49c3cca06f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:52 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Volume volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d (640ddccc-f2e3-49cf-9a8b-55333eb35c5d): created successfully
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598ab9e7-19b2-40ce-b72e-e49c3cca06f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Flow 'volume_create_manager' (db3388d7-7471-41a0-9bc1-e4152e083c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0852d3c8-b5e4-4fe5-a588-aafedbc11ae1 tempest-AttachVolumeTestJSON-2039261099 None] Created volume successfully.
Jul 14 17:56:52 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5" returned: 0 in 0.609s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf343eda-5756-4e7a-8205-71811ff8632b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db93f66-b2ba-4372-a8c4-d610c4fa2410]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:53 devstack sudo[97108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b
Jul 14 17:56:53 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:53 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b" returned: 0 in 0.435s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:53 devstack sudo[97117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5
Jul 14 17:56:53 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:53 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5" returned: 0 in 0.562s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:53 devstack sudo[97127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5
Jul 14 17:56:53 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:54 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b.47f4e0a7-0545-480b-b2bc-29bd395cf3d5" returned: 0 in 0.318s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-47f4e0a7-0545-480b-b2bc-29bd395cf3d5" released by "_delete_snapshot" :: held 2.124s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-bf343eda-5756-4e7a-8205-71811ff8632b" released by "delete_snapshot" :: held 2.167s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:54 devstack cinder-volume[87401]: WARNING cinder.quota [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1888472075 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1888472075, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:54 devstack cinder-volume[87401]: WARNING cinder.quota [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1888472075 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1888472075, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:54 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] Created reservations ['ad36098d-e39a-4f4e-8ecf-1275659b10bc', '8e5a2e58-0587-4ac6-803a-7e43c1201e1a', '9e8e8da7-938a-4a0d-b257-72d9481e1427', '96447d5d-c1ff-4634-84ce-be65c1a6931e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cce59aba-63fd-4555-af10-96cc3f998e57 tempest-GroupSnapshotsTest-210589130 None] group_snapshot d9da4c32-9357-4c50-b495-57cad48385a6: deleted successfully
Jul 14 17:56:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-9307bbf7-d01f-4cfb-9c96-e0e4fad7f94f req-7afc9a47-82f7-4ff5-8aa6-882df4d991f3 tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-9307bbf7-d01f-4cfb-9c96-e0e4fad7f94f req-7afc9a47-82f7-4ff5-8aa6-882df4d991f3 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d503046-68af-4278-ba57-f076bdd4134c]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-9307bbf7-d01f-4cfb-9c96-e0e4fad7f94f req-7afc9a47-82f7-4ff5-8aa6-882df4d991f3 tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:55 devstack sudo[97141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d
Jul 14 17:56:55 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:55 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-9307bbf7-d01f-4cfb-9c96-e0e4fad7f94f req-7afc9a47-82f7-4ff5-8aa6-882df4d991f3 tempest-AttachVolumeTestJSON-2039261099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-9307bbf7-d01f-4cfb-9c96-e0e4fad7f94f req-7afc9a47-82f7-4ff5-8aa6-882df4d991f3 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.425s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-9307bbf7-d01f-4cfb-9c96-e0e4fad7f94f req-7afc9a47-82f7-4ff5-8aa6-882df4d991f3 tempest-AttachVolumeTestJSON-2039261099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74c569d5-d9c6-45c1-8349-a5793904cde2', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:56:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-9307bbf7-d01f-4cfb-9c96-e0e4fad7f94f req-7afc9a47-82f7-4ff5-8aa6-882df4d991f3 tempest-AttachVolumeTestJSON-2039261099 None] attachment_update completed successfully.
Jul 14 17:56:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "cinder-quobyte-bf343eda-5756-4e7a-8205-71811ff8632b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:56:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-bf343eda-5756-4e7a-8205-71811ff8632b" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:56:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f9dbe4-56a2-48eb-8d31-553c7668412b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:56:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:56 devstack sudo[97527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b
Jul 14 17:56:56 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:56 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b" returned: 0 in 0.602s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:56 devstack sudo[97535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b
Jul 14 17:56:56 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:57 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bf343eda-5756-4e7a-8205-71811ff8632b" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Lock "cinder-quobyte-bf343eda-5756-4e7a-8205-71811ff8632b" released by "delete_volume" :: held 1.105s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:56:57 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Created reservations ['5932df1c-e76b-46f0-ad84-157b82cd7e58'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:57 devstack cinder-volume[87401]: WARNING cinder.quota [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1888472075 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1888472075, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:56:57 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Created reservations ['58d1a934-2abd-4ac6-8ecc-32b0f3ffb795', '45156775-7b99-4d33-bf92-53a392d31a94', '27ff9b60-5b03-4455-8c5e-995913c97e8c', '350f78a4-adc7-4698-ba7d-6c551eebb03a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:56:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:57 devstack sudo[97538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:56:57 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:57 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.354s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:57 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:56:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-07fd20ed-e481-4751-9a0b-1149b02e2821 tempest-GroupSnapshotsTest-210589130 None] Delete group completed successfully.
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Flow 'volume_create_manager' (7318cd39-31da-4402-81b7-9938b0f79f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf03658-42ca-4549-8ec2-2187e4162495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf03658-42ca-4549-8ec2-2187e4162495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-917410589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb60997f-8232-4b3a-8929-5b45549760a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59370d7652b844de83ec4a59219e8794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:58Z,use_quota=True,user_id='9b2a315a757b47aca532258c6e86799c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acb2eb9-44c1-4b9f-9c0a-65f79be813d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acb2eb9-44c1-4b9f-9c0a-65f79be813d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e26341-d890-4fd5-9bbd-90b7e651e047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e26341-d890-4fd5-9bbd-90b7e651e047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb60997f-8232-4b3a-8929-5b45549760a0', 'volume_name': 'volume-bb60997f-8232-4b3a-8929-5b45549760a0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005a869f-0fb8-4163-8642-e751c75432d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005a869f-0fb8-4163-8642-e751c75432d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a222d063-fc8b-4daa-ac59-ce1dddc28c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Volume bb60997f-8232-4b3a-8929-5b45549760a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb60997f-8232-4b3a-8929-5b45549760a0', 'volume_size': 1}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-917410589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb60997f-8232-4b3a-8929-5b45549760a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59370d7652b844de83ec4a59219e8794',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:56:58Z,use_quota=True,user_id='9b2a315a757b47aca532258c6e86799c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Creating volume bb60997f-8232-4b3a-8929-5b45549760a0 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:56:58 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:58 devstack sudo[97542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0 1073741824
Jul 14 17:56:58 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:58 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0 1073741824" returned: 0 in 0.612s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:56:58 devstack sudo[97548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0
Jul 14 17:56:58 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:56:59 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root
Jul 14 17:56:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0" returned: 0 in 0.350s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:56:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a222d063-fc8b-4daa-ac59-ce1dddc28c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb60997f-8232-4b3a-8929-5b45549760a0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8004becb-21db-4a6a-8da6-a3ac2f2fe718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:56:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Volume volume-bb60997f-8232-4b3a-8929-5b45549760a0 (bb60997f-8232-4b3a-8929-5b45549760a0): created successfully
Jul 14 17:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8004becb-21db-4a6a-8da6-a3ac2f2fe718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:56:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Flow 'volume_create_manager' (7318cd39-31da-4402-81b7-9938b0f79f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:56:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-834ba293-9a9b-4410-9f9a-f7a6d4067979 tempest-AttachVolumeTestJSON-2039261099 None] Created volume successfully.
Jul 14 17:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-65db8bd0-3157-4d96-a979-652f645067fa req-acaa4ab1-63d2-4c9d-a019-3f973c8a76ee tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-65db8bd0-3157-4d96-a979-652f645067fa req-acaa4ab1-63d2-4c9d-a019-3f973c8a76ee tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3661f46-62a3-4e96-8692-d45fc6befaf1]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-65db8bd0-3157-4d96-a979-652f645067fa req-acaa4ab1-63d2-4c9d-a019-3f973c8a76ee tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:01 devstack sudo[97564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0
Jul 14 17:57:01 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:01 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-65db8bd0-3157-4d96-a979-652f645067fa req-acaa4ab1-63d2-4c9d-a019-3f973c8a76ee tempest-AttachVolumeTestJSON-2039261099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0" returned: 0 in 0.468s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-65db8bd0-3157-4d96-a979-652f645067fa req-acaa4ab1-63d2-4c9d-a019-3f973c8a76ee tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.498s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-65db8bd0-3157-4d96-a979-652f645067fa req-acaa4ab1-63d2-4c9d-a019-3f973c8a76ee tempest-AttachVolumeTestJSON-2039261099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-bb60997f-8232-4b3a-8929-5b45549760a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aebdcb68-d228-400d-9bd3-4f18ec2664b3', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:57:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-65db8bd0-3157-4d96-a979-652f645067fa req-acaa4ab1-63d2-4c9d-a019-3f973c8a76ee tempest-AttachVolumeTestJSON-2039261099 None] attachment_update completed successfully.
Jul 14 17:57:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-a6fb178d-7db4-4c21-a1fd-07c795e5f0e9 req-da672647-270f-43d3-87e5-e8e1e6e2f8bf tempest-AttachVolumeTestJSON-2039261099 None] Terminate volume connection completed successfully.
Jul 14 17:57:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-a6fb178d-7db4-4c21-a1fd-07c795e5f0e9 req-da672647-270f-43d3-87e5-e8e1e6e2f8bf tempest-AttachVolumeTestJSON-2039261099 None] Deleting attachment 74c569d5-d9c6-45c1-8349-a5793904cde2. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:57:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-67c20516-710a-4d9b-8146-0ad3af268965 req-2f95d552-1cad-4d3c-805e-38b8adeffb1f tempest-AttachVolumeTestJSON-2039261099 None] Terminate volume connection completed successfully.
Jul 14 17:57:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-67c20516-710a-4d9b-8146-0ad3af268965 req-2f95d552-1cad-4d3c-805e-38b8adeffb1f tempest-AttachVolumeTestJSON-2039261099 None] Deleting attachment aebdcb68-d228-400d-9bd3-4f18ec2664b3. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Flow 'volume_create_manager' (d00dcaf0-281d-4850-89ff-17d6af580d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4026b46d-200a-4e67-a7c2-85c565bc5305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4026b46d-200a-4e67-a7c2-85c565bc5305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-190532021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2179e876-cb6c-499b-a421-e0cbf35e456c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376a1d59da7244f7ac6212760cafa6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:57:10Z,use_quota=True,user_id='063c98ac628b4e1a9835a7289a247487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752844c6-f9ea-4821-b257-eecb0107441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752844c6-f9ea-4821-b257-eecb0107441a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92ed3bb-098c-44ba-9e00-7f36a3d9eeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c92ed3bb-098c-44ba-9e00-7f36a3d9eeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2179e876-cb6c-499b-a421-e0cbf35e456c', 'volume_name': 'volume-2179e876-cb6c-499b-a421-e0cbf35e456c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13dea54-e122-44ef-81d9-6c1be2dc42ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13dea54-e122-44ef-81d9-6c1be2dc42ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc5f8c7-e2fd-49b0-a872-aac1a69ab32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:09 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Volume 2179e876-cb6c-499b-a421-e0cbf35e456c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2179e876-cb6c-499b-a421-e0cbf35e456c', 'volume_size': 1}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-190532021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2179e876-cb6c-499b-a421-e0cbf35e456c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376a1d59da7244f7ac6212760cafa6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:57:10Z,use_quota=True,user_id='063c98ac628b4e1a9835a7289a247487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Creating volume 2179e876-cb6c-499b-a421-e0cbf35e456c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:57:09 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:57:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:09 devstack sudo[97630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c 1073741824
Jul 14 17:57:09 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:10 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c 1073741824" returned: 0 in 0.540s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:10 devstack sudo[97636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c
Jul 14 17:57:10 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:10 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c" returned: 0 in 0.291s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:57:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc5f8c7-e2fd-49b0-a872-aac1a69ab32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2179e876-cb6c-499b-a421-e0cbf35e456c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e201d890-183c-40ff-8e4c-e453174947d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:10 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Volume volume-2179e876-cb6c-499b-a421-e0cbf35e456c (2179e876-cb6c-499b-a421-e0cbf35e456c): created successfully
Jul 14 17:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e201d890-183c-40ff-8e4c-e453174947d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Flow 'volume_create_manager' (d00dcaf0-281d-4850-89ff-17d6af580d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:57:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2721b102-1750-4813-aab6-446038757765 tempest-SnapshotMetadataTestJSON-2077779371 None] Created volume successfully.
Jul 14 17:57:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "cinder-bb60997f-8232-4b3a-8929-5b45549760a0-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Lock "cinder-bb60997f-8232-4b3a-8929-5b45549760a0-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] Creating offline snapshot dd4f9e0a-0c26-4270-aa7c-be393fd7867e of volume 2179e876-cb6c-499b-a421-e0cbf35e456c {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:57:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "cinder-quobyte-bb60997f-8232-4b3a-8929-5b45549760a0" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Lock "cinder-quobyte-bb60997f-8232-4b3a-8929-5b45549760a0" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d6fc53-cf40-4e40-9efa-750ea69e5241]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3471969-6e9b-40ab-bed2-5b2c19878239]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:12 devstack sudo[97640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c
Jul 14 17:57:12 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:12 devstack sudo[97641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0
Jul 14 17:57:12 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:12 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c" returned: 0 in 0.437s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:12 devstack sudo[97650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e 1G
Jul 14 17:57:12 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:12 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0" returned: 0 in 0.472s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:12 devstack sudo[97652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0
Jul 14 17:57:12 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:12 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-bb60997f-8232-4b3a-8929-5b45549760a0" returned: 0 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Lock "cinder-quobyte-bb60997f-8232-4b3a-8929-5b45549760a0" released by "delete_volume" :: held 0.898s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:12 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Created reservations ['ff2cd931-2160-479a-ac3e-7bffe6695898', '09dc04dc-ed5b-4406-ad0c-317a3883d299', '447b1e5f-2c69-48d6-902d-59e53704b09e', '7cd4ce5b-0580-4385-b7f0-30592e181ca4'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:13 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e 1G" returned: 0 in 0.665s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2179e876-cb6c-499b-a421-e0cbf35e456c -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:13 devstack sudo[97659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:57:13 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:13 devstack sudo[97661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2179e876-cb6c-499b-a421-e0cbf35e456c -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e
Jul 14 17:57:13 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:13 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:57:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Deleted volume successfully.
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae080671-b13f-4e20-bf5f-f78e46730d9d tempest-AttachVolumeTestJSON-2039261099 None] Lock "cinder-bb60997f-8232-4b3a-8929-5b45549760a0-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:13 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2179e876-cb6c-499b-a421-e0cbf35e456c -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e" returned: 0 in 0.369s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:13 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e is being set with open permissions: ugo+rw
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:13 devstack sudo[97667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e
Jul 14 17:57:13 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:13 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e" returned: 0 in 0.270s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:13 devstack sudo[97670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.info
Jul 14 17:57:13 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "cinder-640ddccc-f2e3-49cf-9a8b-55333eb35c5d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:14 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.info" returned: 0 in 0.354s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:14 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.info is being set with open permissions: ugo+rw
Jul 14 17:57:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Lock "cinder-640ddccc-f2e3-49cf-9a8b-55333eb35c5d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:14 devstack sudo[97675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.info
Jul 14 17:57:14 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "cinder-quobyte-640ddccc-f2e3-49cf-9a8b-55333eb35c5d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Lock "cinder-quobyte-640ddccc-f2e3-49cf-9a8b-55333eb35c5d" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:14 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81a60c2-a3ea-458f-9983-167937bcf3ec]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:14 devstack sudo[97677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d
Jul 14 17:57:14 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:14 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.info" returned: 0 in 0.321s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.560s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-708e8611-6d5e-4486-ba9c-ae79a9c667e4 tempest-SnapshotMetadataTestJSON-2077779371 None] Create snapshot completed successfully
Jul 14 17:57:14 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d" returned: 0 in 0.453s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:14 devstack sudo[97683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d
Jul 14 17:57:14 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:15 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-640ddccc-f2e3-49cf-9a8b-55333eb35c5d" returned: 0 in 0.324s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Lock "cinder-quobyte-640ddccc-f2e3-49cf-9a8b-55333eb35c5d" released by "delete_volume" :: held 0.855s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Created reservations ['34e95e30-774e-4cde-8249-dccb6e809d7f', '01ff519d-fa43-4702-8245-71c534682064', '64a3e1dc-a81e-4e91-86c7-d176f6feb6db', '61c750a0-f194-49ef-9916-49e5580b3cdc'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Flow 'volume_create_manager' (0660f560-6b7c-411e-9ce7-93af43052cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0cfb34-e3de-49cd-abd3-aec3b0268bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0cfb34-e3de-49cd-abd3-aec3b0268bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-577789032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c12ce1f-2a39-4bca-ba22-5717c7abaf64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a256b1fa4fb944e9ac3085aa2e343c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:57:15Z,use_quota=True,user_id='94213e09fe2a46f687aae57cca80fade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:15 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:57:15 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2639d06c-3873-4fa6-ab32-6ed1ed4b49af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2639d06c-3873-4fa6-ab32-6ed1ed4b49af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e766c09d-8452-454e-ab8f-8b75897dcdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e766c09d-8452-454e-ab8f-8b75897dcdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c12ce1f-2a39-4bca-ba22-5717c7abaf64', 'volume_name': 'volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ad4ded-59bd-4a08-93b3-a687055d26ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ad4ded-59bd-4a08-93b3-a687055d26ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c82cab3-4f75-45a6-9c04-9dda665c58e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:15 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Volume 6c12ce1f-2a39-4bca-ba22-5717c7abaf64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64', 'volume_size': 1}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-577789032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c12ce1f-2a39-4bca-ba22-5717c7abaf64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a256b1fa4fb944e9ac3085aa2e343c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:57:15Z,use_quota=True,user_id='94213e09fe2a46f687aae57cca80fade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Creating volume 6c12ce1f-2a39-4bca-ba22-5717c7abaf64 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:57:15 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:15 devstack sudo[97688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64 1073741824
Jul 14 17:57:15 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:15 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:57:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Deleted volume successfully.
Jul 14 17:57:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-385c76e8-c343-44da-9f78-85b95b9772b7 tempest-AttachVolumeTestJSON-2039261099 None] Lock "cinder-640ddccc-f2e3-49cf-9a8b-55333eb35c5d-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:16 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64 1073741824" returned: 0 in 0.570s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Acquiring lock "cinder-dd4f9e0a-0c26-4270-aa7c-be393fd7867e-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:16 devstack sudo[97695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64
Jul 14 17:57:16 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "cinder-dd4f9e0a-0c26-4270-aa7c-be393fd7867e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Acquiring lock "cinder-quobyte-2179e876-cb6c-499b-a421-e0cbf35e456c" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "cinder-quobyte-2179e876-cb6c-499b-a421-e0cbf35e456c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Acquiring lock "cinder-quobyte-dd4f9e0a-0c26-4270-aa7c-be393fd7867e" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "cinder-quobyte-dd4f9e0a-0c26-4270-aa7c-be393fd7867e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Deleting offline snapshot dd4f9e0a-0c26-4270-aa7c-be393fd7867e of volume 2179e876-cb6c-499b-a421-e0cbf35e456c {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] snapshot_file for this snap is: volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefb7307-ceb1-46d2-bff2-3ab445320c6a]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:16 devstack sudo[97697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e
Jul 14 17:57:16 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:16 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64" returned: 0 in 0.312s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c82cab3-4f75-45a6-9c04-9dda665c58e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb87b6a-f915-4fcf-85af-1c6c3aba7453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:16 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Volume volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64 (6c12ce1f-2a39-4bca-ba22-5717c7abaf64): created successfully
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb87b6a-f915-4fcf-85af-1c6c3aba7453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Flow 'volume_create_manager' (0660f560-6b7c-411e-9ce7-93af43052cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "cinder-95fd8b60-b924-4254-8a3d-948bd12cbb9e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9129b8b2-f583-42d9-9087-6c7fd412132f tempest-VolumeQuotasAdminTestJSON-2027317519 None] Created volume successfully.
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Lock "cinder-95fd8b60-b924-4254-8a3d-948bd12cbb9e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "cinder-quobyte-95fd8b60-b924-4254-8a3d-948bd12cbb9e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Lock "cinder-quobyte-95fd8b60-b924-4254-8a3d-948bd12cbb9e" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eb213c-2417-4fd7-87fb-0607b91afd2e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:16 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e" returned: 0 in 0.573s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2179e876-cb6c-499b-a421-e0cbf35e456c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:57:16 devstack sudo[97700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e
Jul 14 17:57:16 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c882de70-2121-4496-8822-5ca4b2f84d3f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:16 devstack sudo[97705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c
Jul 14 17:57:16 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:17 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e" returned: 0 in 0.522s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:17 devstack sudo[97711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e
Jul 14 17:57:17 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:17 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c" returned: 0 in 0.417s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:17 devstack sudo[97716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e
Jul 14 17:57:17 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:17 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-95fd8b60-b924-4254-8a3d-948bd12cbb9e" returned: 0 in 0.349s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Lock "cinder-quobyte-95fd8b60-b924-4254-8a3d-948bd12cbb9e" released by "delete_volume" :: held 0.939s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Acquiring lock "cinder-6c12ce1f-2a39-4bca-ba22-5717c7abaf64-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "cinder-6c12ce1f-2a39-4bca-ba22-5717c7abaf64-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Acquiring lock "cinder-quobyte-6c12ce1f-2a39-4bca-ba22-5717c7abaf64" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "cinder-quobyte-6c12ce1f-2a39-4bca-ba22-5717c7abaf64" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Created reservations ['2e3b8d5f-6e5f-40e4-83d4-ef828f1e8e68', '7de1e5b9-eb4f-4332-9be5-0a7c13ba408f', 'c3edfe94-73c7-4a41-b77c-ba464cca7532', '4f16d607-194b-4ff8-9d8a-7b35cfd1387f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[389c548b-9fd0-4f0b-a0cd-0ae0cca91034]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:17 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e" returned: 0 in 0.559s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:17 devstack sudo[97724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:57:17 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:17 devstack sudo[97725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e
Jul 14 17:57:17 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:17 devstack sudo[97723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64
Jul 14 17:57:17 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:18 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.318s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:57:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Deleted volume successfully.
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f868fa9a-9c4a-4db4-8a07-647eab42cf6f tempest-AttachVolumeTestJSON-2039261099 None] Lock "cinder-95fd8b60-b924-4254-8a3d-948bd12cbb9e-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:18 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:18 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c.dd4f9e0a-0c26-4270-aa7c-be393fd7867e" returned: 0 in 0.433s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64" returned: 0 in 0.562s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:18 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64
Jul 14 17:57:18 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "cinder-quobyte-dd4f9e0a-0c26-4270-aa7c-be393fd7867e" released by "_delete_snapshot" :: held 2.146s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "cinder-quobyte-2179e876-cb6c-499b-a421-e0cbf35e456c" released by "delete_snapshot" :: held 2.171s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Created reservations ['382e3a99-70ec-4965-bf8d-1c3e98b92205', '22adc615-5391-403b-b20e-03dfa457e916', 'c666baba-565d-46e7-88e6-44ce75d353fb', 'cd49acc2-3e9c-4029-806f-79a5fcd61ac6'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:57:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Delete snapshot completed successfully.
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2d6d9fdd-c520-4aaf-aae6-ac9256e0a47e tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "cinder-dd4f9e0a-0c26-4270-aa7c-be393fd7867e-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:18 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6c12ce1f-2a39-4bca-ba22-5717c7abaf64" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "cinder-quobyte-6c12ce1f-2a39-4bca-ba22-5717c7abaf64" released by "delete_volume" :: held 0.937s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Created reservations ['074e6d47-38b3-4abf-8204-3dcfd588b402', '404da514-eaa5-4246-9974-b6fff55520ed', '6befb259-0cb5-4512-89f6-7be6176b573f', 'cf55d7d2-397c-40ea-a0ad-7b9f6ded32b6'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:18 devstack sudo[97737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:57:18 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:19 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.316s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:19 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:57:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Deleted volume successfully.
Jul 14 17:57:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-98f9a142-13df-43a2-9d5f-eef320b2f676 tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "cinder-6c12ce1f-2a39-4bca-ba22-5717c7abaf64-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Acquiring lock "cinder-2179e876-cb6c-499b-a421-e0cbf35e456c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "cinder-2179e876-cb6c-499b-a421-e0cbf35e456c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Acquiring lock "cinder-quobyte-2179e876-cb6c-499b-a421-e0cbf35e456c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "cinder-quobyte-2179e876-cb6c-499b-a421-e0cbf35e456c" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:19 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e37e85e-fb37-4aff-873a-ca5ea80c698f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:19 devstack sudo[97741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c
Jul 14 17:57:19 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:20 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c" returned: 0 in 0.490s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:20 devstack sudo[97746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c
Jul 14 17:57:20 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:20 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2179e876-cb6c-499b-a421-e0cbf35e456c" returned: 0 in 0.422s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "cinder-quobyte-2179e876-cb6c-499b-a421-e0cbf35e456c" released by "delete_volume" :: held 0.998s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Flow 'volume_create_manager' (50731c69-a208-4bbe-bccd-73b9ae2d1932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd32f27e-fd38-4c1d-975e-98b46dfdf624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Created reservations ['3cfb7ac5-295d-40dd-aac4-618ae2270c79', '89674d6c-360b-4e9f-ac2b-9d0b60b61ddc', '81ab0f8a-1662-4aed-9817-57b992a00d26', '3def98a0-9690-484b-b3a3-14d3a5d129de'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd32f27e-fd38-4c1d-975e-98b46dfdf624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-270912555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2eb22e-24ec-4768-b4d1-af1a908431fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a256b1fa4fb944e9ac3085aa2e343c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:57:20Z,use_quota=True,user_id='94213e09fe2a46f687aae57cca80fade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508c30bf-cb2a-494e-9af7-1757271c4b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (508c30bf-cb2a-494e-9af7-1757271c4b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8fb256-499d-40f6-bb35-d0faaf8c84c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8fb256-499d-40f6-bb35-d0faaf8c84c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2eb22e-24ec-4768-b4d1-af1a908431fa', 'volume_name': 'volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55633a3-0f2d-4364-96fe-7cd47b17ea94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55633a3-0f2d-4364-96fe-7cd47b17ea94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a03be0-d4c6-4066-9420-249c5d29f30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:20 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Volume 7a2eb22e-24ec-4768-b4d1-af1a908431fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa', 'volume_size': 1}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-270912555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2eb22e-24ec-4768-b4d1-af1a908431fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a256b1fa4fb944e9ac3085aa2e343c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:57:20Z,use_quota=True,user_id='94213e09fe2a46f687aae57cca80fade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Creating volume 7a2eb22e-24ec-4768-b4d1-af1a908431fa {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:57:20 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:20 devstack sudo[97749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa 1073741824
Jul 14 17:57:20 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:20 devstack sudo[97751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:57:20 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:20 devstack sudo[97753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:57:20 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:21 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:57:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Deleted volume successfully.
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-64a93a49-3c8d-4dee-a92e-c7f9f7738cac tempest-SnapshotMetadataTestJSON-2077779371 None] Lock "cinder-2179e876-cb6c-499b-a421-e0cbf35e456c-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:21 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.471s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:57:21 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa 1073741824" returned: 0 in 0.645s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:21 devstack sudo[97761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa
Jul 14 17:57:21 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:21 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa" returned: 0 in 0.374s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a03be0-d4c6-4066-9420-249c5d29f30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87288522-b88a-49e0-8bbc-1760d98001ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Volume volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa (7a2eb22e-24ec-4768-b4d1-af1a908431fa): created successfully
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87288522-b88a-49e0-8bbc-1760d98001ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Flow 'volume_create_manager' (50731c69-a208-4bbe-bccd-73b9ae2d1932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:57:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bcae74b1-f442-4aac-92f2-7a861efbb4cf tempest-VolumeQuotasAdminTestJSON-2027317519 None] Created volume successfully.
Jul 14 17:57:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-37ee35ea-55c7-432a-b91b-d6c6732eee4e tempest-VolumeQuotasAdminTestJSON-788723546 None] Transfer volume completed successfully.
Jul 14 17:57:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Acquiring lock "cinder-7a2eb22e-24ec-4768-b4d1-af1a908431fa-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Lock "cinder-7a2eb22e-24ec-4768-b4d1-af1a908431fa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Acquiring lock "cinder-quobyte-7a2eb22e-24ec-4768-b4d1-af1a908431fa" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Lock "cinder-quobyte-7a2eb22e-24ec-4768-b4d1-af1a908431fa" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e843d69-329b-4ed2-a656-372420f4b992]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:24 devstack sudo[97767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa
Jul 14 17:57:24 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:24 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa" returned: 0 in 0.482s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:24 devstack sudo[97773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa
Jul 14 17:57:24 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:25 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7a2eb22e-24ec-4768-b4d1-af1a908431fa" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Lock "cinder-quobyte-7a2eb22e-24ec-4768-b4d1-af1a908431fa" released by "delete_volume" :: held 0.869s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:25 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Created reservations ['9c2a0469-f1ee-46c3-8a4b-12beda721fb3', '3ad2876f-66e7-4cfe-b704-34d8dd2661a3', '3c3a6d64-ba65-4c01-9531-b678a58a7f4d', '6e11daed-91e7-46d9-96db-f9a3e89b2de6'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:25 devstack sudo[97776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:57:25 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:25 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.483s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:25 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:57:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Deleted volume successfully.
Jul 14 17:57:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-abf07ecf-5a2a-42a7-bf05-a0198db8bca0 tempest-VolumeQuotasAdminTestJSON-1737418708 None] Lock "cinder-7a2eb22e-24ec-4768-b4d1-af1a908431fa-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Flow 'volume_create_manager' (dd32c63d-4b16-4694-8a20-9141e4d8ee6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f557b95-7de3-4abe-af73-3919e398bb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f557b95-7de3-4abe-af73-3919e398bb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1856711227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348a80fa-dacb-4fc3-b7dd-6f97e42331b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5fef1ac3794862b21c3a224462e451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:57:27Z,use_quota=True,user_id='038e495ef8b94ad888d3526451a215fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3395e2-0afc-44b5-b879-7b1a79c62b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3395e2-0afc-44b5-b879-7b1a79c62b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2386a48a-194a-4f48-9b70-b2fa1f131893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2386a48a-194a-4f48-9b70-b2fa1f131893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '348a80fa-dacb-4fc3-b7dd-6f97e42331b5', 'volume_name': 'volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b577ac-e176-4ed8-96c9-f2176af107ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b577ac-e176-4ed8-96c9-f2176af107ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f8442c-ace8-4f89-a44c-4d8bbfe60213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Volume 348a80fa-dacb-4fc3-b7dd-6f97e42331b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5', 'volume_size': 1}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1856711227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348a80fa-dacb-4fc3-b7dd-6f97e42331b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5fef1ac3794862b21c3a224462e451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:57:27Z,use_quota=True,user_id='038e495ef8b94ad888d3526451a215fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Creating volume 348a80fa-dacb-4fc3-b7dd-6f97e42331b5 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:57:26 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:57:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:26 devstack sudo[97779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5 1073741824
Jul 14 17:57:26 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:27 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5 1073741824" returned: 0 in 0.608s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:27 devstack sudo[97786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5
Jul 14 17:57:27 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:27 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:57:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f8442c-ace8-4f89-a44c-4d8bbfe60213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ccfebe0-d5f6-4d91-be6c-3c3f4d12acb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:27 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Volume volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5 (348a80fa-dacb-4fc3-b7dd-6f97e42331b5): created successfully
Jul 14 17:57:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ccfebe0-d5f6-4d91-be6c-3c3f4d12acb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Flow 'volume_create_manager' (dd32c63d-4b16-4694-8a20-9141e4d8ee6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:57:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b580eb51-6265-4634-9c4a-9600c4722cbe tempest-VolumesMetadataTest-2073063643 None] Created volume successfully.
Jul 14 17:57:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Acquiring lock "cinder-348a80fa-dacb-4fc3-b7dd-6f97e42331b5-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Lock "cinder-348a80fa-dacb-4fc3-b7dd-6f97e42331b5-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Acquiring lock "cinder-quobyte-348a80fa-dacb-4fc3-b7dd-6f97e42331b5" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Lock "cinder-quobyte-348a80fa-dacb-4fc3-b7dd-6f97e42331b5" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f5dbee-542f-4444-a35b-8300c19c84e4]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:30 devstack sudo[97790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5
Jul 14 17:57:30 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:30 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5" returned: 0 in 0.477s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:30 devstack sudo[97796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5
Jul 14 17:57:30 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:30 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-348a80fa-dacb-4fc3-b7dd-6f97e42331b5" returned: 0 in 0.291s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Lock "cinder-quobyte-348a80fa-dacb-4fc3-b7dd-6f97e42331b5" released by "delete_volume" :: held 0.838s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:30 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Created reservations ['5171e772-aaa4-44af-9452-e793766d5598', '58dfd91e-1940-440d-9b79-b336ef3a8c6e', 'abae0226-7eac-4f5f-80cb-b5d02dd33b07', '2b5647cf-de9f-4569-9f86-e9df7fc6ea9e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:57:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:31 devstack sudo[97799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:57:31 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:31 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.342s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:31 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:57:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Deleted volume successfully.
Jul 14 17:57:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-442cee8f-bbbc-46bf-9b62-2cfbf062006e tempest-VolumesMetadataTest-2073063643 None] Lock "cinder-348a80fa-dacb-4fc3-b7dd-6f97e42331b5-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Flow 'volume_create_manager' (72cdadd9-7611-464e-85a8-3a3392ca4590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c741024f-fe85-40dd-a7c7-6256b72e534b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c741024f-fe85-40dd-a7c7-6256b72e534b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-760050669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104435f8-5126-4d8f-beab-e6e5cf48a6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85801f6191324571a877011459d04292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:57:33Z,use_quota=True,user_id='25807ffd0a524f42930086ea0392dac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3e5986-a779-472d-9454-6e855f2d54f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3e5986-a779-472d-9454-6e855f2d54f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cd3981-3241-43f1-b682-153dbc65bad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cd3981-3241-43f1-b682-153dbc65bad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '104435f8-5126-4d8f-beab-e6e5cf48a6b3', 'volume_name': 'volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3359d9b2-ca60-4af7-846f-a27a3474b7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3359d9b2-ca60-4af7-846f-a27a3474b7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b917384-8fa3-420c-b69a-4dae32de8c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Volume 104435f8-5126-4d8f-beab-e6e5cf48a6b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3', 'volume_size': 1}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-760050669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104435f8-5126-4d8f-beab-e6e5cf48a6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85801f6191324571a877011459d04292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:57:33Z,use_quota=True,user_id='25807ffd0a524f42930086ea0392dac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Creating volume 104435f8-5126-4d8f-beab-e6e5cf48a6b3 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:57:33 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:33 devstack sudo[97802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3 1073741824
Jul 14 17:57:33 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:33 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3 1073741824" returned: 0 in 0.618s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:34 devstack sudo[97808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3
Jul 14 17:57:34 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:34 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3" returned: 0 in 0.409s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:57:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b917384-8fa3-420c-b69a-4dae32de8c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1946bb-fbcc-4b17-b7a5-07b6a7834d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:34 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Volume volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3 (104435f8-5126-4d8f-beab-e6e5cf48a6b3): created successfully
Jul 14 17:57:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1946bb-fbcc-4b17-b7a5-07b6a7834d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Flow 'volume_create_manager' (72cdadd9-7611-464e-85a8-3a3392ca4590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:57:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-771b7549-21f5-4eda-a19c-a867ed4522da req-1761d91d-94c7-43ed-a9d7-348910a494ce tempest-VolumesSnapshotsTestJSON-463601749 None] Created volume successfully.
Jul 14 17:57:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] Creating offline snapshot b7822b08-9047-417b-b100-6894f4040717 of volume 104435f8-5126-4d8f-beab-e6e5cf48a6b3 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:57:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5e4957-f94e-4d05-8c71-2848d494f0cf]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:36 devstack sudo[97811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3
Jul 14 17:57:36 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:36 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3" returned: 0 in 0.717s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:36 devstack sudo[97852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717 1G
Jul 14 17:57:36 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:37 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717 1G" returned: 0 in 0.614s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:37 devstack sudo[97858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717
Jul 14 17:57:37 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:37 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717" returned: 0 in 0.451s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:37 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717 is being set with open permissions: ugo+rw
Jul 14 17:57:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:37 devstack sudo[97864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717
Jul 14 17:57:37 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:37 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:38 devstack sudo[97867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.info
Jul 14 17:57:38 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:38 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.info" returned: 0 in 0.361s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:38 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.info is being set with open permissions: ugo+rw
Jul 14 17:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:38 devstack sudo[97870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.info
Jul 14 17:57:38 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:38 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.info" returned: 0 in 0.326s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.956s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-5dd67aa5-f1c2-46ee-9a2b-f0b4696ea836 req-cef0f8e3-9de7-4a3f-a2ea-f2d38a3d2beb tempest-VolumesSnapshotsTestJSON-463601749 None] Create snapshot completed successfully
Jul 14 17:57:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Acquiring lock "cinder-b7822b08-9047-417b-b100-6894f4040717-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "cinder-b7822b08-9047-417b-b100-6894f4040717-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Acquiring lock "cinder-quobyte-104435f8-5126-4d8f-beab-e6e5cf48a6b3" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "cinder-quobyte-104435f8-5126-4d8f-beab-e6e5cf48a6b3" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Acquiring lock "cinder-quobyte-b7822b08-9047-417b-b100-6894f4040717" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "cinder-quobyte-b7822b08-9047-417b-b100-6894f4040717" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Deleting offline snapshot b7822b08-9047-417b-b100-6894f4040717 of volume 104435f8-5126-4d8f-beab-e6e5cf48a6b3 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:57:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] snapshot_file for this snap is: volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:57:40 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea056ff-9250-4c25-aa6c-8a9efb6563d1]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:40 devstack sudo[97874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717
Jul 14 17:57:40 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:40 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717" returned: 0 in 0.618s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:57:40 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[469584b8-3fd5-4498-84d9-71f1d3425ad1]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:40 devstack sudo[97879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3
Jul 14 17:57:40 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:41 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3" returned: 0 in 0.531s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:41 devstack sudo[97885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717
Jul 14 17:57:41 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:41 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717" returned: 0 in 0.441s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:41 devstack sudo[97890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717
Jul 14 17:57:41 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:42 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3.b7822b08-9047-417b-b100-6894f4040717" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "cinder-quobyte-b7822b08-9047-417b-b100-6894f4040717" released by "_delete_snapshot" :: held 2.097s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "cinder-quobyte-104435f8-5126-4d8f-beab-e6e5cf48a6b3" released by "delete_snapshot" :: held 2.143s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:42 devstack cinder-volume[87401]: DEBUG cinder.quota [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Created reservations ['cfc816c2-245f-4ec4-b73e-16d9668ff087', '6b4df1e8-c78d-496f-a461-6533996081fd', '02173a67-1675-42de-8ad8-e907a0dfef16', '59761336-4612-404d-80d9-cd49a20c3f29'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:57:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Delete snapshot completed successfully.
Jul 14 17:57:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-d2cb77a1-4e52-4299-bb6e-c6704ac55bfe req-c0100235-df4f-44bc-8849-22dfe650c190 tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "cinder-b7822b08-9047-417b-b100-6894f4040717-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Flow 'volume_create_manager' (0b3e8109-5729-4dfb-9f36-cc2ab35734a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b6cc0f-55a8-47f3-8a3c-964e5b8587fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b6cc0f-55a8-47f3-8a3c-964e5b8587fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1916166437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8909a9-22c5-4408-9fce-287d566e5145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34305696498649b08db07d4a2ee25d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:57:43Z,use_quota=True,user_id='c0899d1f292f4867b434e707ccbff8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b8a918-3a82-4ef9-a4d7-df72f565a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b8a918-3a82-4ef9-a4d7-df72f565a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb30c4a8-7f4a-439a-a4ed-09551d7d18d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Acquiring lock "cinder-104435f8-5126-4d8f-beab-e6e5cf48a6b3-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "cinder-104435f8-5126-4d8f-beab-e6e5cf48a6b3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Acquiring lock "cinder-quobyte-104435f8-5126-4d8f-beab-e6e5cf48a6b3" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "cinder-quobyte-104435f8-5126-4d8f-beab-e6e5cf48a6b3" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[30be3957-60c5-4f30-9ebd-c0a27e8b3a1a]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:43 devstack sudo[97893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3
Jul 14 17:57:43 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb30c4a8-7f4a-439a-a4ed-09551d7d18d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da8909a9-22c5-4408-9fce-287d566e5145', 'volume_name': 'volume-da8909a9-22c5-4408-9fce-287d566e5145', 'volume_size': 1, 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b35106125384bcf9ba800ba74e8254d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'created_at': datetime.datetime(2026, 7, 14, 15, 43, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 43, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3eef7b-9b54-4ea1-a240-6be757f56381/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca339070>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0e1bd7-17bb-4a1b-89c2-58ab978e98d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0e1bd7-17bb-4a1b-89c2-58ab978e98d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ce4999-2055-48a5-aae1-778d6f786130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:43 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Volume da8909a9-22c5-4408-9fce-287d566e5145: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da8909a9-22c5-4408-9fce-287d566e5145', 'volume_size': 1, 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b35106125384bcf9ba800ba74e8254d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'created_at': datetime.datetime(2026, 7, 14, 15, 43, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 43, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3eef7b-9b54-4ea1-a240-6be757f56381/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca339070>}
Jul 14 17:57:43 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Trying to clone da8909a9-22c5-4408-9fce-287d566e5145 from image af3eef7b-9b54-4ea1-a240-6be757f56381 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 17:57:44 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3" returned: 0 in 0.477s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:44 devstack sudo[97898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3
Jul 14 17:57:44 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:44 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-104435f8-5126-4d8f-beab-e6e5cf48a6b3" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "cinder-quobyte-104435f8-5126-4d8f-beab-e6e5cf48a6b3" released by "delete_volume" :: held 0.936s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 17:57:44 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Image download 20.69 MB at 20.69 MB/s
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[634f75c9-c532-4df4-9588-738f0fa84f81]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG cinder.quota [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Created reservations ['bef7da36-4d95-4443-bcf0-ed48852c3160', '410802c2-5259-466d-ab1c-c5e069ad8348', '5fb65798-0378-45f3-9a50-2d30f312bf84', 'd05c2ec7-7efc-4768-86aa-d67146863557'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:44 devstack sudo[97903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:57:44 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:44 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD
Jul 14 17:57:44 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:44 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:44 devstack cinder-volume[87401]: DEBUG cinder.manager [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:57:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Deleted volume successfully.
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-10a6ddb6-9b41-46e7-9d7d-68abec370003 req-de3d526e-bbe3-4994-8efd-f45b44dd52f2 tempest-VolumesSnapshotsTestJSON-463601749 None] Lock "cinder-104435f8-5126-4d8f-beab-e6e5cf48a6b3-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:57:45 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD" returned: 0 in 0.612s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Temporary image af3eef7b-9b54-4ea1-a240-6be757f56381 is fetched for user c0899d1f292f4867b434e707ccbff8f2. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3790dc1a-e7fe-4372-9571-1bfacdc3b8a7]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:45 devstack sudo[97910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD
Jul 14 17:57:45 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:45 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1916166437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8909a9-22c5-4408-9fce-287d566e5145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34305696498649b08db07d4a2ee25d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:57:43Z,use_quota=True,user_id='c0899d1f292f4867b434e707ccbff8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Creating volume da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:57:45 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:57:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:45 devstack sudo[97918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 1073741824
Jul 14 17:57:45 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:46 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 1073741824" returned: 0 in 0.591s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:46 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=112,cinder:UPDATE=137,cinder:INSERT=34,cinder:DELETE=10 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:57:46 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=121,cinder:UPDATE=128,cinder:DELETE=9,cinder:INSERT=31 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:57:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:46 devstack sudo[97924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145
Jul 14 17:57:46 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:46 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145" returned: 0 in 0.294s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:57:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:57:46 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Attempting download of af3eef7b-9b54-4ea1-a240-6be757f56381 ((None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}])) to volume da8909a9-22c5-4408-9fce-287d566e5145. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 17:57:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[53445c8e-64ea-481d-9236-c992b20a7cf9]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_q4eteroe {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:46 devstack sudo[97927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_q4eteroe
Jul 14 17:57:46 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:47 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_q4eteroe" returned: 0 in 0.359s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_q4eteroe {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:47 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_q4eteroe
Jul 14 17:57:47 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:47 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_q4eteroe" returned: 1 in 0.373s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_q4eteroe' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:57:47 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb48ad84-05d2-4279-b505-7023f8dac5f6]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:47 devstack sudo[97935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD
Jul 14 17:57:47 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:48 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:48 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] af3eef7b-9b54-4ea1-a240-6be757f56381 was qcow2, converting to raw {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 17:57:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:48 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145
Jul 14 17:57:48 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:49 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145" returned: 0 in 1.884s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:49 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_wastlzukdevstack@QuobyteHD, size 112.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 17:57:49 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Converted 112.00 MB image at 59.41 MB/s
Jul 14 17:57:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:49 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 1G
Jul 14 17:57:49 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:50 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 1G" returned: 0 in 0.357s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba60008c-483b-48f9-8153-3b71336dfdc3]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:50 devstack sudo[97954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145
Jul 14 17:57:50 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:50 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145" returned: 0 in 0.393s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:50 devstack sudo[97958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145
Jul 14 17:57:50 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:51 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145" returned: 1 in 0.465s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Downloaded image af3eef7b-9b54-4ea1-a240-6be757f56381 ((None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}])) to volume da8909a9-22c5-4408-9fce-287d566e5145 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 17:57:51 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Temporary image af3eef7b-9b54-4ea1-a240-6be757f56381 for user c0899d1f292f4867b434e707ccbff8f2 is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 17:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Marking volume da8909a9-22c5-4408-9fce-287d566e5145 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 17:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Copying metadata from image af3eef7b-9b54-4ea1-a240-6be757f56381 to da8909a9-22c5-4408-9fce-287d566e5145. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 17:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Creating volume glance metadata for volume da8909a9-22c5-4408-9fce-287d566e5145 backed by image af3eef7b-9b54-4ea1-a240-6be757f56381 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 17:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ce4999-2055-48a5-aae1-778d6f786130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8909a9-22c5-4408-9fce-287d566e5145', 'volume_size': 1, 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b35106125384bcf9ba800ba74e8254d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'created_at': datetime.datetime(2026, 7, 14, 15, 43, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 43, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3eef7b-9b54-4ea1-a240-6be757f56381/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca339070>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4252ec52-313f-4cba-97ca-98e7ee7929e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:57:51 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Volume volume-da8909a9-22c5-4408-9fce-287d566e5145 (da8909a9-22c5-4408-9fce-287d566e5145): created successfully
Jul 14 17:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4252ec52-313f-4cba-97ca-98e7ee7929e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:57:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Flow 'volume_create_manager' (0b3e8109-5729-4dfb-9f36-cc2ab35734a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:57:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fb4a1ad5-7408-46ff-a0d9-892f641d1b8f tempest-TestShelveInstance-2129979753 None] Created volume successfully.
Jul 14 17:57:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ff16256a-4643-4bac-9ed3-b360bb00ad8a tempest-GroupsV314Test-1345935731 None] Group tempest-GroupsV314Test-Group-258775729: creating
Jul 14 17:57:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ff16256a-4643-4bac-9ed3-b360bb00ad8a tempest-GroupsV314Test-1345935731 None] Group tempest-GroupsV314Test-Group-258775729: created successfully
Jul 14 17:57:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ff16256a-4643-4bac-9ed3-b360bb00ad8a tempest-GroupsV314Test-1345935731 None] Create group completed successfully.
Jul 14 17:57:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-dd1e5e37-516d-4937-94ca-f5a1bd0413cd req-aa421011-c5d2-4401-b158-0f393a126baa tempest-TestShelveInstance-2129979753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:57:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-dd1e5e37-516d-4937-94ca-f5a1bd0413cd req-aa421011-c5d2-4401-b158-0f393a126baa tempest-TestShelveInstance-2129979753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:57:59 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fc818d-e20b-40f9-9199-2c4e0bc77d16]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:57:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-dd1e5e37-516d-4937-94ca-f5a1bd0413cd req-aa421011-c5d2-4401-b158-0f393a126baa tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:59 devstack sudo[97980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145
Jul 14 17:57:59 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:57:59 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root
Jul 14 17:57:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-dd1e5e37-516d-4937-94ca-f5a1bd0413cd req-aa421011-c5d2-4401-b158-0f393a126baa tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145" returned: 0 in 0.374s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:57:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-dd1e5e37-516d-4937-94ca-f5a1bd0413cd req-aa421011-c5d2-4401-b158-0f393a126baa tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:57:59 devstack sudo[97985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145
Jul 14 17:57:59 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:00 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-dd1e5e37-516d-4937-94ca-f5a1bd0413cd req-aa421011-c5d2-4401-b158-0f393a126baa tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145" returned: 1 in 0.461s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-dd1e5e37-516d-4937-94ca-f5a1bd0413cd req-aa421011-c5d2-4401-b158-0f393a126baa tempest-TestShelveInstance-2129979753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-dd1e5e37-516d-4937-94ca-f5a1bd0413cd req-aa421011-c5d2-4401-b158-0f393a126baa tempest-TestShelveInstance-2129979753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.888s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-dd1e5e37-516d-4937-94ca-f5a1bd0413cd req-aa421011-c5d2-4401-b158-0f393a126baa tempest-TestShelveInstance-2129979753 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-da8909a9-22c5-4408-9fce-287d566e5145', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fbd88fc-4e0b-4c57-9eb2-080dd9cdab10', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:58:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-dd1e5e37-516d-4937-94ca-f5a1bd0413cd req-aa421011-c5d2-4401-b158-0f393a126baa tempest-TestShelveInstance-2129979753 None] attachment_update completed successfully.
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Flow 'volume_create_manager' (33cc8eff-e18f-4330-8664-5dcfc23ca4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bf3565-9b42-432e-ac57-06158bf2119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bf3565-9b42-432e-ac57-06158bf2119e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1609564791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15d369e8-e7c0-49c6-a2b5-34ae90fd0c63,host='devstack@QuobyteHD#QuobyteHD',id=822974d3-2e77-4da1-a52e-e063cf4241e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720d8d36de1a4394a491bb5f71fcb2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:00Z,use_quota=True,user_id='ab0aa54f337a42c2b3954fcf77b748c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a41148-f5c5-4f9e-94c3-a69c3a8bd034),volume_type_id=a2a41148-f5c5-4f9e-94c3-a69c3a8bd034)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c377c95a-295c-4ef4-b80a-8fd2b9b77acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c377c95a-295c-4ef4-b80a-8fd2b9b77acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbac628-0089-4112-8129-105de3f9d1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbac628-0089-4112-8129-105de3f9d1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '822974d3-2e77-4da1-a52e-e063cf4241e5', 'volume_name': 'volume-822974d3-2e77-4da1-a52e-e063cf4241e5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3902c608-5e1e-436b-9395-c94e686d98f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3902c608-5e1e-436b-9395-c94e686d98f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30dfbf9-a99d-4548-9486-c8c1448ca993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Volume 822974d3-2e77-4da1-a52e-e063cf4241e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-822974d3-2e77-4da1-a52e-e063cf4241e5', 'volume_size': 1}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=15d369e8-e7c0-49c6-a2b5-34ae90fd0c63,created_at=2026-07-14T15:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1609564791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=15d369e8-e7c0-49c6-a2b5-34ae90fd0c63,host='devstack@QuobyteHD#QuobyteHD',id=822974d3-2e77-4da1-a52e-e063cf4241e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720d8d36de1a4394a491bb5f71fcb2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:00Z,use_quota=True,user_id='ab0aa54f337a42c2b3954fcf77b748c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a41148-f5c5-4f9e-94c3-a69c3a8bd034),volume_type_id=a2a41148-f5c5-4f9e-94c3-a69c3a8bd034)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Creating volume 822974d3-2e77-4da1-a52e-e063cf4241e5 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:58:00 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:58:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:00 devstack sudo[97990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 1073741824
Jul 14 17:58:00 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:01 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 1073741824" returned: 0 in 0.485s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:01 devstack sudo[97996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5
Jul 14 17:58:01 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:01 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:58:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30dfbf9-a99d-4548-9486-c8c1448ca993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-822974d3-2e77-4da1-a52e-e063cf4241e5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19120419-9275-4d91-a7af-801b2c88e424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Volume volume-822974d3-2e77-4da1-a52e-e063cf4241e5 (822974d3-2e77-4da1-a52e-e063cf4241e5): created successfully
Jul 14 17:58:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19120419-9275-4d91-a7af-801b2c88e424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Flow 'volume_create_manager' (33cc8eff-e18f-4330-8664-5dcfc23ca4f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d400e09f-8d24-4298-96c7-7263421d8247 tempest-GroupsV314Test-1345935731 None] Created volume successfully.
Jul 14 17:58:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:02 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Cloning volume 822974d3-2e77-4da1-a52e-e063cf4241e5 to volume 3fe397c5-488e-426d-98b0-1c2e4014cade
Jul 14 17:58:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Creating offline snapshot 60409924-5edc-461d-ae24-85367cd294a7 of volume 822974d3-2e77-4da1-a52e-e063cf4241e5 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:58:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8065e08-72d3-4789-b643-aafa73949269]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:02 devstack sudo[98000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5
Jul 14 17:58:02 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:03 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5" returned: 0 in 0.486s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:03 devstack sudo[98005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7 1G
Jul 14 17:58:03 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:03 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7 1G" returned: 0 in 0.512s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-822974d3-2e77-4da1-a52e-e063cf4241e5 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:03 devstack sudo[98011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-822974d3-2e77-4da1-a52e-e063cf4241e5 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7
Jul 14 17:58:03 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:04 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-822974d3-2e77-4da1-a52e-e063cf4241e5 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7" returned: 0 in 0.484s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:04 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7 is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:58:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:04 devstack sudo[98017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7
Jul 14 17:58:04 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:04 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:04 devstack sudo[98020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.info
Jul 14 17:58:04 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:05 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.info" returned: 0 in 0.421s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:05 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:05 devstack sudo[98024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.info
Jul 14 17:58:05 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:05 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.info" returned: 0 in 0.302s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Acquiring lock "cinder-quobyte-3fe397c5-488e-426d-98b0-1c2e4014cade" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Lock "cinder-quobyte-3fe397c5-488e-426d-98b0-1c2e4014cade" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] snapshot: 60409924-5edc-461d-ae24-85367cd294a7, volume: 3fe397c5-488e-426d-98b0-1c2e4014cade,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b703b84-aa11-4385-a9f6-d3df028361c0]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:05 devstack sudo[98028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7
Jul 14 17:58:05 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:05 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7" returned: 0 in 0.477s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-822974d3-2e77-4da1-a52e-e063cf4241e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b19f0f-0286-4bab-ae0d-cdd2ac36e3e4]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:06 devstack sudo[98033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5
Jul 14 17:58:06 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:06 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5" returned: 0 in 0.411s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:06 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Path /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 17:58:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:06 devstack sudo[98039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade
Jul 14 17:58:06 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:12 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade" returned: 0 in 5.720s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cb7fcf-5768-450f-aa66-6b1f3ac83a13]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:12 devstack sudo[98054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5
Jul 14 17:58:12 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:12 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5" returned: 0 in 0.706s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:12 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 17:58:12 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Converted 1024.00 MB image at 178.98 MB/s
Jul 14 17:58:12 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 17:58:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:12 devstack sudo[98059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade
Jul 14 17:58:12 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:13 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Lock "cinder-quobyte-3fe397c5-488e-426d-98b0-1c2e4014cade" released by "_copy_volume_from_snapshot" :: held 7.784s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Acquiring lock "cinder-quobyte-60409924-5edc-461d-ae24-85367cd294a7" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Lock "cinder-quobyte-60409924-5edc-461d-ae24-85367cd294a7" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Deleting offline snapshot 60409924-5edc-461d-ae24-85367cd294a7 of volume 822974d3-2e77-4da1-a52e-e063cf4241e5 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:58:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] snapshot_file for this snap is: volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:58:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bc95c2-19af-4767-9601-a50e291e55f5]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:13 devstack sudo[98062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7
Jul 14 17:58:13 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:13 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7" returned: 0 in 0.648s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-822974d3-2e77-4da1-a52e-e063cf4241e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:58:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c67ede-b962-4551-b8cd-ec6bb4c43412]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:14 devstack sudo[98114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5
Jul 14 17:58:14 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:14 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=13 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:58:14 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5" returned: 0 in 0.728s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:14 devstack sudo[98172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7
Jul 14 17:58:14 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:15 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7" returned: 0 in 0.753s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:15 devstack sudo[98518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7
Jul 14 17:58:15 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:16 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5.60409924-5edc-461d-ae24-85367cd294a7" returned: 0 in 0.644s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Lock "cinder-quobyte-60409924-5edc-461d-ae24-85367cd294a7" released by "_delete_snapshot" :: held 2.931s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.524s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c3e95fb8-cbf9-4da9-9e29-22f7552c49fc tempest-GroupsV314Test-1345935731 None] Create group from source-group-15d369e8-e7c0-49c6-a2b5-34ae90fd0c63 completed successfully.
Jul 14 17:58:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Acquiring lock "cinder-quobyte-3fe397c5-488e-426d-98b0-1c2e4014cade" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Lock "cinder-quobyte-3fe397c5-488e-426d-98b0-1c2e4014cade" acquired by "delete_volume" :: waited 0.045s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ff0893-1d37-483d-b7ea-95f626c8894f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:17 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade
Jul 14 17:58:17 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:18 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade" returned: 0 in 1.110s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:18 devstack sudo[98537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade
Jul 14 17:58:18 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:19 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3fe397c5-488e-426d-98b0-1c2e4014cade" returned: 0 in 0.530s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Lock "cinder-quobyte-3fe397c5-488e-426d-98b0-1c2e4014cade" released by "delete_volume" :: held 1.743s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:19 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Created reservations ['5f2bd0fe-d578-48c5-a596-aafb3250acd9'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:58:19 devstack cinder-volume[87401]: WARNING cinder.quota [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1074631205 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1074631205, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:58:19 devstack cinder-volume[87401]: WARNING cinder.quota [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1074631205 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1074631205, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:58:19 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Created reservations ['034fca68-a10f-4bc2-aa1e-3b8ed8758fd1', '14692be5-c380-4caf-80e5-3ab3c12afd94', 'c563d793-caa0-4c7b-adc9-dde986b53d87', 'a91579f4-9be7-4c70-948e-1f5d1a2ee399'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:58:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:19 devstack sudo[98545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:58:19 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:20 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:20 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:58:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-551569f9-d4c5-4598-8421-39cb7a2aaaa7 tempest-GroupsV314Test-1345935731 None] Delete group completed successfully.
Jul 14 17:58:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Acquiring lock "cinder-quobyte-822974d3-2e77-4da1-a52e-e063cf4241e5" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:58:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Lock "cinder-quobyte-822974d3-2e77-4da1-a52e-e063cf4241e5" acquired by "delete_volume" :: waited 0.172s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:20 devstack sudo[98559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:58:20 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[602926a3-819b-4270-88eb-0a5a24df8960]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:58:21 devstack sudo[98566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5
Jul 14 17:58:21 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Flow 'volume_create_manager' (664ef029-4636-42a0-82d0-0e4f073991ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8981440b-804b-4aa8-869c-5ab1579ffcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8981440b-804b-4aa8-869c-5ab1579ffcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-181073235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1358b2b1-188a-450f-85da-b6c2f4fe5670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656006fbf5bf4699b6c2d7e3486b4e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:21Z,use_quota=True,user_id='ac5caa2d3ded4c7a8d35aef138216a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46029e43-33ba-4ea4-90a8-892497f1dff3),volume_type_id=46029e43-33ba-4ea4-90a8-892497f1dff3)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a137b7-3372-40ad-9ae5-519c0e5deedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a137b7-3372-40ad-9ae5-519c0e5deedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e335a53e-16cd-4600-b473-3835a2c28c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e335a53e-16cd-4600-b473-3835a2c28c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1358b2b1-188a-450f-85da-b6c2f4fe5670', 'volume_name': 'volume-1358b2b1-188a-450f-85da-b6c2f4fe5670', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a851d03b-53dd-4d89-bc25-b25b38a57d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a851d03b-53dd-4d89-bc25-b25b38a57d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc25438-1b12-4446-b888-a3618dad06fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Volume 1358b2b1-188a-450f-85da-b6c2f4fe5670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1358b2b1-188a-450f-85da-b6c2f4fe5670', 'volume_size': 1}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-181073235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1358b2b1-188a-450f-85da-b6c2f4fe5670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656006fbf5bf4699b6c2d7e3486b4e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:21Z,use_quota=True,user_id='ac5caa2d3ded4c7a8d35aef138216a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46029e43-33ba-4ea4-90a8-892497f1dff3),volume_type_id=46029e43-33ba-4ea4-90a8-892497f1dff3)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Creating volume 1358b2b1-188a-450f-85da-b6c2f4fe5670 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:58:21 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:21 devstack sudo[98568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670 1073741824
Jul 14 17:58:21 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:21 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.963s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:58:21 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5" returned: 0 in 0.827s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:22 devstack sudo[98574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5
Jul 14 17:58:22 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:22 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:58:22 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Flow 'volume_create_manager' (d0949441-3259-411b-bd67-3547ca411be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f50946-9076-4609-a8c7-005630b92604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-822974d3-2e77-4da1-a52e-e063cf4241e5" returned: 0 in 0.896s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670 1073741824" returned: 0 in 1.234s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f50946-9076-4609-a8c7-005630b92604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-480962904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43faf0b-6649-4cfc-875a-0f196be9afb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656006fbf5bf4699b6c2d7e3486b4e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:23Z,use_quota=True,user_id='ac5caa2d3ded4c7a8d35aef138216a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f991800-a48a-44ae-ac39-bf71e61c42f5),volume_type_id=0f991800-a48a-44ae-ac39-bf71e61c42f5)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b95aa59-d5e3-4d16-858d-84eaf43566e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b95aa59-d5e3-4d16-858d-84eaf43566e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7783519e-e24c-4dd5-99f0-6b8969fdd11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7783519e-e24c-4dd5-99f0-6b8969fdd11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43faf0b-6649-4cfc-875a-0f196be9afb1', 'volume_name': 'volume-e43faf0b-6649-4cfc-875a-0f196be9afb1', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d76afb3-dc68-42d9-a9e7-e73b94c419dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d76afb3-dc68-42d9-a9e7-e73b94c419dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658194b4-50c1-473d-918d-b19db86273bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Volume e43faf0b-6649-4cfc-875a-0f196be9afb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43faf0b-6649-4cfc-875a-0f196be9afb1', 'volume_size': 1}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Lock "cinder-quobyte-822974d3-2e77-4da1-a52e-e063cf4241e5" released by "delete_volume" :: held 2.008s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Created reservations ['52c5feb5-60d7-4666-895c-558186d7443c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:58:23 devstack sudo[98580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670
Jul 14 17:58:23 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Created reservations ['3b82cdf8-6296-4e8c-8158-137474164a55', '5391a955-9827-4b41-9643-1ffa98157f05', '33d463ae-227a-416b-bc19-4292ecd43315', '685d42bb-ce35-47c6-865d-fc015c6c5a62'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:23 devstack sudo[98582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:58:23 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:23 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670" returned: 0 in 0.647s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-480962904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43faf0b-6649-4cfc-875a-0f196be9afb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656006fbf5bf4699b6c2d7e3486b4e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:23Z,use_quota=True,user_id='ac5caa2d3ded4c7a8d35aef138216a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f991800-a48a-44ae-ac39-bf71e61c42f5),volume_type_id=0f991800-a48a-44ae-ac39-bf71e61c42f5)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Creating volume e43faf0b-6649-4cfc-875a-0f196be9afb1 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:58:23 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:23 devstack sudo[98585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1 1073741824
Jul 14 17:58:23 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc25438-1b12-4446-b888-a3618dad06fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1358b2b1-188a-450f-85da-b6c2f4fe5670', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c0b1c1-a778-4ec6-8f8f-f5cab16b7375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Volume volume-1358b2b1-188a-450f-85da-b6c2f4fe5670 (1358b2b1-188a-450f-85da-b6c2f4fe5670): created successfully
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c0b1c1-a778-4ec6-8f8f-f5cab16b7375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Flow 'volume_create_manager' (664ef029-4636-42a0-82d0-0e4f073991ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-945fc5e3-b795-46b4-9e14-473f034d9ae4 tempest-TestInstancesWithCinderVolumes-1844393437 None] Created volume successfully.
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Flow 'volume_create_manager' (3bf7fbdf-2ed5-44e3-ad38-2fe10ab5704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a785a640-c578-4b56-94c5-fed326c4bb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a785a640-c578-4b56-94c5-fed326c4bb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1666310904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d3eea4-bc89-4e3c-94bf-40d48be62e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656006fbf5bf4699b6c2d7e3486b4e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:24Z,use_quota=True,user_id='ac5caa2d3ded4c7a8d35aef138216a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(175ccfae-4c83-46d0-b1d2-97a04d9b4815),volume_type_id=175ccfae-4c83-46d0-b1d2-97a04d9b4815)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764afd2d-3398-4909-9445-30dd028011d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764afd2d-3398-4909-9445-30dd028011d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8c9d9c-b0bf-4a78-a0c3-19bc39ad5c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 17:58:24 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.680s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:58:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-856d4e3e-30c5-4e3f-a04f-235e1cebab1e tempest-GroupsV314Test-1345935731 None] Delete group completed successfully.
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8c9d9c-b0bf-4a78-a0c3-19bc39ad5c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8d3eea4-bc89-4e3c-94bf-40d48be62e2b', 'volume_name': 'volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b', 'volume_size': 1, 'image_id': '6457b9ba-c081-4440-8886-cc308ef1f092', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6457b9ba-c081-4440-8886-cc308ef1f092', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1174227289', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '656006fbf5bf4699b6c2d7e3486b4e1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6457b9ba-c081-4440-8886-cc308ef1f092', 'created_at': datetime.datetime(2026, 7, 14, 15, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 58, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6457b9ba-c081-4440-8886-cc308ef1f092/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca377560>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4ff371-439f-4cf9-9cd9-968e0fa18822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4ff371-439f-4cf9-9cd9-968e0fa18822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be73e862-adff-49f5-b16c-b98fcc43be9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:24 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Volume d8d3eea4-bc89-4e3c-94bf-40d48be62e2b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b', 'volume_size': 1, 'image_id': '6457b9ba-c081-4440-8886-cc308ef1f092', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6457b9ba-c081-4440-8886-cc308ef1f092', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1174227289', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '656006fbf5bf4699b6c2d7e3486b4e1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6457b9ba-c081-4440-8886-cc308ef1f092', 'created_at': datetime.datetime(2026, 7, 14, 15, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 58, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6457b9ba-c081-4440-8886-cc308ef1f092/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca377560>}
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Trying to clone d8d3eea4-bc89-4e3c-94bf-40d48be62e2b from image 6457b9ba-c081-4440-8886-cc308ef1f092 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6457b9ba-c081-4440-8886-cc308ef1f092', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 17:58:24 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1 1073741824" returned: 0 in 1.196s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:25 devstack sudo[98594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1
Jul 14 17:58:25 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:25 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1" returned: 0 in 0.518s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:58:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658194b4-50c1-473d-918d-b19db86273bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43faf0b-6649-4cfc-875a-0f196be9afb1', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1b0743-f98a-44b7-b0f7-efc9df6ad49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:25 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Volume volume-e43faf0b-6649-4cfc-875a-0f196be9afb1 (e43faf0b-6649-4cfc-875a-0f196be9afb1): created successfully
Jul 14 17:58:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1b0743-f98a-44b7-b0f7-efc9df6ad49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Flow 'volume_create_manager' (d0949441-3259-411b-bd67-3547ca411be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b7ecbc73-33b2-4e19-b822-b810825b42a1 tempest-TestInstancesWithCinderVolumes-1844393437 None] Created volume successfully.
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Flow 'volume_create_manager' (aa27edd4-5829-4927-a35b-851dd4395acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f49f3b-5775-4f8d-b3ad-3ea14ab02093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f49f3b-5775-4f8d-b3ad-3ea14ab02093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-971060946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330d8df2-b5cc-4146-a569-9ea4b7808c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b664b2f64d4407b5f81429f744853c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:31Z,use_quota=True,user_id='c73368753bde4d7bb94c6acb34881cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e58b63-5212-4ebe-8d8d-a9a93a67457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e58b63-5212-4ebe-8d8d-a9a93a67457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a00a2ff-2439-4303-acbd-b8056186dfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a00a2ff-2439-4303-acbd-b8056186dfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '330d8df2-b5cc-4146-a569-9ea4b7808c2d', 'volume_name': 'volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe3e475-94d8-408c-9689-2a6dfee73681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe3e475-94d8-408c-9689-2a6dfee73681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5895d9a0-398e-4211-a6ff-66b9ee5b68d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:30 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Volume 330d8df2-b5cc-4146-a569-9ea4b7808c2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d', 'volume_size': 1}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-971060946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330d8df2-b5cc-4146-a569-9ea4b7808c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b664b2f64d4407b5f81429f744853c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:31Z,use_quota=True,user_id='c73368753bde4d7bb94c6acb34881cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Creating volume 330d8df2-b5cc-4146-a569-9ea4b7808c2d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:58:30 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:58:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:31 devstack sudo[98668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d 1073741824
Jul 14 17:58:31 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:31 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d 1073741824" returned: 0 in 0.647s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:31 devstack sudo[98674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d
Jul 14 17:58:31 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:32 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d" returned: 0 in 0.503s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:58:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5895d9a0-398e-4211-a6ff-66b9ee5b68d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee1442f-7a83-486f-96e8-72239cfc4368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:32 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Volume volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d (330d8df2-b5cc-4146-a569-9ea4b7808c2d): created successfully
Jul 14 17:58:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee1442f-7a83-486f-96e8-72239cfc4368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Flow 'volume_create_manager' (aa27edd4-5829-4927-a35b-851dd4395acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9d3266c0-fb98-4cbb-8105-30bfc6608184 tempest-VolumesActionsTest-219961976 None] Created volume successfully.
Jul 14 17:58:32 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD, size 20.69 MB, duration 7.97 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 17:58:32 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Image download 20.69 MB at 2.59 MB/s
Jul 14 17:58:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[934e549f-de13-4872-adf5-789c81f85f39]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:32 devstack sudo[98677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD
Jul 14 17:58:32 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b75d49b8-0707-4176-a76a-eaa5f9429da8 tempest-VolumesActionsTest-219961976 None] Acquiring lock "cinder-330d8df2-b5cc-4146-a569-9ea4b7808c2d" by "attach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b75d49b8-0707-4176-a76a-eaa5f9429da8 tempest-VolumesActionsTest-219961976 None] Lock "cinder-330d8df2-b5cc-4146-a569-9ea4b7808c2d" acquired by "attach_volume" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:33 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD" returned: 0 in 0.512s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Temporary image 6457b9ba-c081-4440-8886-cc308ef1f092 is fetched for user ac5caa2d3ded4c7a8d35aef138216a08. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 17:58:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b75d49b8-0707-4176-a76a-eaa5f9429da8 tempest-VolumesActionsTest-219961976 None] Attaching volume 330d8df2-b5cc-4146-a569-9ea4b7808c2d to instance 648d6490-aacd-4a9b-8649-4b72ed1f95cc at mountpoint /dev/vdb on host None.
Jul 14 17:58:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b75d49b8-0707-4176-a76a-eaa5f9429da8 tempest-VolumesActionsTest-219961976 None] Attach volume completed successfully.
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b75d49b8-0707-4176-a76a-eaa5f9429da8 tempest-VolumesActionsTest-219961976 None] Lock "cinder-330d8df2-b5cc-4146-a569-9ea4b7808c2d" released by "attach_volume" :: held 0.216s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[50085a9a-77cb-4bd2-9b7f-77245230e050]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:33 devstack sudo[98683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD
Jul 14 17:58:33 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:33 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1666310904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d3eea4-bc89-4e3c-94bf-40d48be62e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656006fbf5bf4699b6c2d7e3486b4e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:24Z,use_quota=True,user_id='ac5caa2d3ded4c7a8d35aef138216a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(175ccfae-4c83-46d0-b1d2-97a04d9b4815),volume_type_id=175ccfae-4c83-46d0-b1d2-97a04d9b4815)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Creating volume d8d3eea4-bc89-4e3c-94bf-40d48be62e2b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:58:33 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:58:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:33 devstack sudo[98689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b 1073741824
Jul 14 17:58:33 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2cce8972-b4a7-4688-aba0-722ffa3e4881 tempest-VolumesActionsTest-2100406115 None] Terminate volume connection completed successfully.
Jul 14 17:58:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2cce8972-b4a7-4688-aba0-722ffa3e4881 tempest-VolumesActionsTest-2100406115 None] Acquiring lock "cinder-330d8df2-b5cc-4146-a569-9ea4b7808c2d-detach_volume" by "detach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2cce8972-b4a7-4688-aba0-722ffa3e4881 tempest-VolumesActionsTest-2100406115 None] Lock "cinder-330d8df2-b5cc-4146-a569-9ea4b7808c2d-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2cce8972-b4a7-4688-aba0-722ffa3e4881 tempest-VolumesActionsTest-2100406115 None] Detaching volume 330d8df2-b5cc-4146-a569-9ea4b7808c2d from instance 648d6490-aacd-4a9b-8649-4b72ed1f95cc.
Jul 14 17:58:34 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b 1073741824" returned: 0 in 0.709s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d155e177-3aa4-4529-8822-d401bb7a6fe1 tempest-GroupsV320Test-1445390797 None] Group tempest-GroupsV320Test-Group-2239265: creating
Jul 14 17:58:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2cce8972-b4a7-4688-aba0-722ffa3e4881 tempest-VolumesActionsTest-2100406115 None] Detach volume completed successfully.
Jul 14 17:58:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2cce8972-b4a7-4688-aba0-722ffa3e4881 tempest-VolumesActionsTest-2100406115 None] Lock "cinder-330d8df2-b5cc-4146-a569-9ea4b7808c2d-detach_volume" released by "detach_volume" :: held 0.245s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:34 devstack sudo[98798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b
Jul 14 17:58:34 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d155e177-3aa4-4529-8822-d401bb7a6fe1 tempest-GroupsV320Test-1445390797 None] Group tempest-GroupsV320Test-Group-2239265: created successfully
Jul 14 17:58:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d155e177-3aa4-4529-8822-d401bb7a6fe1 tempest-GroupsV320Test-1445390797 None] Create group completed successfully.
Jul 14 17:58:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5d618cd8-4d31-4c3f-a613-5416f374415f tempest-VolumesActionsTest-219961976 None] Acquiring lock "cinder-330d8df2-b5cc-4146-a569-9ea4b7808c2d-detach_volume" by "detach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5d618cd8-4d31-4c3f-a613-5416f374415f tempest-VolumesActionsTest-219961976 None] Lock "cinder-330d8df2-b5cc-4146-a569-9ea4b7808c2d-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5d618cd8-4d31-4c3f-a613-5416f374415f tempest-VolumesActionsTest-219961976 None] Volume detach called, but volume not attached.
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5d618cd8-4d31-4c3f-a613-5416f374415f tempest-VolumesActionsTest-219961976 None] Lock "cinder-330d8df2-b5cc-4146-a569-9ea4b7808c2d-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:35 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b" returned: 0 in 0.448s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Attempting download of 6457b9ba-c081-4440-8886-cc308ef1f092 ((None, [{'url': 'file:///opt/stack/data/glance/images/6457b9ba-c081-4440-8886-cc308ef1f092', 'metadata': {}}])) to volume d8d3eea4-bc89-4e3c-94bf-40d48be62e2b. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[df44a096-3e53-4758-86ca-bf66fd778718]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6457b9ba-c081-4440-8886-cc308ef1f092_ub33p6m6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Acquiring lock "cinder-330d8df2-b5cc-4146-a569-9ea4b7808c2d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Lock "cinder-330d8df2-b5cc-4146-a569-9ea4b7808c2d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Acquiring lock "cinder-quobyte-330d8df2-b5cc-4146-a569-9ea4b7808c2d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Lock "cinder-quobyte-330d8df2-b5cc-4146-a569-9ea4b7808c2d" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:35 devstack sudo[98801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6457b9ba-c081-4440-8886-cc308ef1f092_ub33p6m6
Jul 14 17:58:35 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e6fbe1-6b64-422c-bd44-aa24af11f106]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:35 devstack sudo[98803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d
Jul 14 17:58:35 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:35 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6457b9ba-c081-4440-8886-cc308ef1f092_ub33p6m6" returned: 0 in 0.536s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6457b9ba-c081-4440-8886-cc308ef1f092_ub33p6m6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:35 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d" returned: 0 in 0.494s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:35 devstack sudo[98809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6457b9ba-c081-4440-8886-cc308ef1f092_ub33p6m6
Jul 14 17:58:35 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:36 devstack sudo[98811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d
Jul 14 17:58:36 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:36 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:36 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6457b9ba-c081-4440-8886-cc308ef1f092_ub33p6m6" returned: 1 in 0.589s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6457b9ba-c081-4440-8886-cc308ef1f092_ub33p6m6' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-330d8df2-b5cc-4146-a569-9ea4b7808c2d" returned: 0 in 0.420s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d91285-11b5-4209-9c58-94f1c238b0ad]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Lock "cinder-quobyte-330d8df2-b5cc-4146-a569-9ea4b7808c2d" released by "delete_volume" :: held 0.998s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Created reservations ['652a055c-52e2-44dd-95d0-715cc28eb167', '60a7e130-7f18-4f34-9dd9-79046dced9c6', '267a2a08-f930-4aa4-b005-7e2e4d435b92', '1beb7763-7267-4cf0-a7df-cb5d86c24582'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:58:36 devstack sudo[98817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD
Jul 14 17:58:36 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fcd929ff-df79-4bdc-80cc-9c04cc636fd3 tempest-GroupsV320Test-1445390797 None] Created reservations ['2cef9348-65fe-47bd-9052-33afb117b047'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_db.api [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction')
Jul 14 17:58:36 devstack cinder-volume[87401]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at
Jul 14 17:58:36 devstack cinder-volume[87401]: FROM reservations
Jul 14 17:58:36 devstack cinder-volume[87401]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s) FOR UPDATE]
Jul 14 17:58:36 devstack cinder-volume[87401]: [parameters: {'uuid_1_1': '652a055c-52e2-44dd-95d0-715cc28eb167', 'uuid_1_2': '60a7e130-7f18-4f34-9dd9-79046dced9c6', 'uuid_1_3': '267a2a08-f930-4aa4-b005-7e2e4d435b92', 'uuid_1_4': '1beb7763-7267-4cf0-a7df-cb5d86c24582'}]
Jul 14 17:58:36 devstack cinder-volume[87401]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=87401) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_db.api [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=87401) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcd929ff-df79-4bdc-80cc-9c04cc636fd3 tempest-GroupsV320Test-1445390797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcd929ff-df79-4bdc-80cc-9c04cc636fd3 tempest-GroupsV320Test-1445390797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fcd929ff-df79-4bdc-80cc-9c04cc636fd3 tempest-GroupsV320Test-1445390797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fcd929ff-df79-4bdc-80cc-9c04cc636fd3 tempest-GroupsV320Test-1445390797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fcd929ff-df79-4bdc-80cc-9c04cc636fd3 tempest-GroupsV320Test-1445390797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcd929ff-df79-4bdc-80cc-9c04cc636fd3 tempest-GroupsV320Test-1445390797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:36 devstack sudo[98819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:58:36 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:36 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] 6457b9ba-c081-4440-8886-cc308ef1f092 was qcow2, converting to raw {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:36 devstack sudo[98838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b
Jul 14 17:58:36 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:36 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fcd929ff-df79-4bdc-80cc-9c04cc636fd3 tempest-GroupsV320Test-1445390797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:36 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-fcd929ff-df79-4bdc-80cc-9c04cc636fd3 tempest-GroupsV320Test-1445390797 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:58:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fcd929ff-df79-4bdc-80cc-9c04cc636fd3 tempest-GroupsV320Test-1445390797 None] Delete group completed successfully.
Jul 14 17:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:37 devstack sudo[98867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:58:37 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:38 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.489s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:38 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:58:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Deleted volume successfully.
Jul 14 17:58:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e30c0110-e87f-4c45-809b-bcac32666d79 tempest-VolumesActionsTest-219961976 None] Lock "cinder-330d8df2-b5cc-4146-a569-9ea4b7808c2d-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:38 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b" returned: 0 in 2.124s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:38 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6457b9ba-c081-4440-8886-cc308ef1f092_447bbgnndevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 17:58:38 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Converted 112.00 MB image at 52.71 MB/s
Jul 14 17:58:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:38 devstack sudo[98892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b 1G
Jul 14 17:58:38 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:39 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b 1G" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:39 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[225063fc-0907-4f89-a741-7d8e8ab3ce44]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:39 devstack sudo[98900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b
Jul 14 17:58:39 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:39 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b" returned: 0 in 0.470s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:40 devstack sudo[98905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b
Jul 14 17:58:40 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:40 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b" returned: 1 in 0.452s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:58:40 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Downloaded image 6457b9ba-c081-4440-8886-cc308ef1f092 ((None, [{'url': 'file:///opt/stack/data/glance/images/6457b9ba-c081-4440-8886-cc308ef1f092', 'metadata': {}}])) to volume d8d3eea4-bc89-4e3c-94bf-40d48be62e2b successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 17:58:40 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Temporary image 6457b9ba-c081-4440-8886-cc308ef1f092 for user ac5caa2d3ded4c7a8d35aef138216a08 is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 17:58:40 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Marking volume d8d3eea4-bc89-4e3c-94bf-40d48be62e2b as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 17:58:40 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Copying metadata from image 6457b9ba-c081-4440-8886-cc308ef1f092 to d8d3eea4-bc89-4e3c-94bf-40d48be62e2b. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 17:58:40 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Creating volume glance metadata for volume d8d3eea4-bc89-4e3c-94bf-40d48be62e2b backed by image 6457b9ba-c081-4440-8886-cc308ef1f092 with: {'image_id': '6457b9ba-c081-4440-8886-cc308ef1f092', 'image_name': 'tempest-scenario-img--1174227289', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 17:58:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be73e862-adff-49f5-b16c-b98fcc43be9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b', 'volume_size': 1, 'image_id': '6457b9ba-c081-4440-8886-cc308ef1f092', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6457b9ba-c081-4440-8886-cc308ef1f092', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1174227289', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '656006fbf5bf4699b6c2d7e3486b4e1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6457b9ba-c081-4440-8886-cc308ef1f092', 'created_at': datetime.datetime(2026, 7, 14, 15, 58, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 58, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6457b9ba-c081-4440-8886-cc308ef1f092/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca377560>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0762035d-e71d-483a-8121-ad7f468d6cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:40 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Volume volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b (d8d3eea4-bc89-4e3c-94bf-40d48be62e2b): created successfully
Jul 14 17:58:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0762035d-e71d-483a-8121-ad7f468d6cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Flow 'volume_create_manager' (3bf7fbdf-2ed5-44e3-ad38-2fe10ab5704c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:40 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2c90dd52-f3e1-4193-bcdc-7ba89b7b0604 tempest-TestInstancesWithCinderVolumes-1844393437 None] Created volume successfully.
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Flow 'volume_create_manager' (c6469175-b739-4ce6-811e-a28ca46e8c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a021cb7-9eea-48e2-b0a7-1d47b376b8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a021cb7-9eea-48e2-b0a7-1d47b376b8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1186443885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b664b2f64d4407b5f81429f744853c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:41Z,use_quota=True,user_id='c73368753bde4d7bb94c6acb34881cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4e02af-a5bd-453d-b48b-a5729d2bc65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4e02af-a5bd-453d-b48b-a5729d2bc65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a088b1-b649-4d11-ad5a-2d45d43ee15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a088b1-b649-4d11-ad5a-2d45d43ee15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e', 'volume_name': 'volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33ff2e2-1efc-44da-99df-759fc31e1b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33ff2e2-1efc-44da-99df-759fc31e1b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1edd69d-383c-4efe-abbc-45507b3a09e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:41 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Volume 28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e', 'volume_size': 1}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1186443885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b664b2f64d4407b5f81429f744853c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:41Z,use_quota=True,user_id='c73368753bde4d7bb94c6acb34881cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Creating volume 28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:58:41 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:41 devstack sudo[98910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e 1073741824
Jul 14 17:58:41 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:41 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e 1073741824" returned: 0 in 0.497s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:41 devstack sudo[98916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e
Jul 14 17:58:41 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:42 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:58:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1edd69d-383c-4efe-abbc-45507b3a09e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe3ad11-65fc-475b-b859-9eda54e9d1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:42 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Volume volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e (28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e): created successfully
Jul 14 17:58:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe3ad11-65fc-475b-b859-9eda54e9d1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Flow 'volume_create_manager' (c6469175-b739-4ce6-811e-a28ca46e8c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6cf4dc92-ebf8-45a7-be73-d710bec5c49a tempest-VolumesActionsTest-219961976 None] Created volume successfully.
Jul 14 17:58:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Acquiring lock "cinder-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Lock "cinder-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Acquiring lock "cinder-quobyte-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Lock "cinder-quobyte-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:43 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbb4247-af74-4f52-92b0-33333f245c4b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:43 devstack sudo[98922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e
Jul 14 17:58:43 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:44 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e" returned: 0 in 0.557s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:44 devstack sudo[98927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e
Jul 14 17:58:44 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:44 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e" returned: 0 in 0.403s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Lock "cinder-quobyte-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e" released by "delete_volume" :: held 1.032s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:44 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Created reservations ['d8bc6647-9fc0-461e-98a0-f381f7003a6b', 'bde9f0ec-3ae8-4f85-880a-30633807b9d3', 'd7424343-9981-44f0-b5d5-00a7a214de80', 'f138db58-af10-49e6-b1b1-b59166a1fe64'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:45 devstack sudo[98938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:58:45 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ad2bb365-bf18-4de6-99a5-cb29c2451ab2 req-ce73eac1-aef5-4457-a528-2160349cfddb tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ad2bb365-bf18-4de6-99a5-cb29c2451ab2 req-ce73eac1-aef5-4457-a528-2160349cfddb tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99566e7-a8c4-4b90-819c-4311fe4de15e]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ad2bb365-bf18-4de6-99a5-cb29c2451ab2 req-ce73eac1-aef5-4457-a528-2160349cfddb tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:45 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.542s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:58:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Deleted volume successfully.
Jul 14 17:58:45 devstack sudo[98940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b
Jul 14 17:58:45 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6b94f585-ad38-4540-9fa2-0c2d505389df tempest-VolumesActionsTest-2100406115 None] Lock "cinder-28bd77c1-0d4c-4e2b-a9d1-816d4141ec3e-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:45 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ad2bb365-bf18-4de6-99a5-cb29c2451ab2 req-ce73eac1-aef5-4457-a528-2160349cfddb tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b" returned: 0 in 0.684s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ad2bb365-bf18-4de6-99a5-cb29c2451ab2 req-ce73eac1-aef5-4457-a528-2160349cfddb tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:46 devstack sudo[98945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b
Jul 14 17:58:46 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:46 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ad2bb365-bf18-4de6-99a5-cb29c2451ab2 req-ce73eac1-aef5-4457-a528-2160349cfddb tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b" returned: 1 in 0.437s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-ad2bb365-bf18-4de6-99a5-cb29c2451ab2 req-ce73eac1-aef5-4457-a528-2160349cfddb tempest-TestInstancesWithCinderVolumes-1844393437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-ad2bb365-bf18-4de6-99a5-cb29c2451ab2 req-ce73eac1-aef5-4457-a528-2160349cfddb tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.220s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-ad2bb365-bf18-4de6-99a5-cb29c2451ab2 req-ce73eac1-aef5-4457-a528-2160349cfddb tempest-TestInstancesWithCinderVolumes-1844393437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b87c6432-5b4e-4200-a458-60eaa94d3873', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=83,cinder:INSERT=32,cinder:UPDATE=80,cinder:DELETE=4 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:58:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-ad2bb365-bf18-4de6-99a5-cb29c2451ab2 req-ce73eac1-aef5-4457-a528-2160349cfddb tempest-TestInstancesWithCinderVolumes-1844393437 None] attachment_update completed successfully.
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Flow 'volume_create_manager' (5f8d7f39-3709-4073-9ffb-727ca7e67119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbb76cb-74cc-492f-ae8d-883d14320722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbb76cb-74cc-492f-ae8d-883d14320722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-641172833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb49a837-6024-41cc-8666-3d014f0e2ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b664b2f64d4407b5f81429f744853c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:47Z,use_quota=True,user_id='c73368753bde4d7bb94c6acb34881cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a84fd3b-b5ea-4c08-8757-3b2230ce88e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a84fd3b-b5ea-4c08-8757-3b2230ce88e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fbaeab-3695-4bf0-8023-98b64ba9e251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fbaeab-3695-4bf0-8023-98b64ba9e251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb49a837-6024-41cc-8666-3d014f0e2ebd', 'volume_name': 'volume-fb49a837-6024-41cc-8666-3d014f0e2ebd', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc49b778-c598-450e-a7e8-620f8db7d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc49b778-c598-450e-a7e8-620f8db7d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aebfb94-1f34-45df-bf73-1b00258d9941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:47 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Volume fb49a837-6024-41cc-8666-3d014f0e2ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb49a837-6024-41cc-8666-3d014f0e2ebd', 'volume_size': 1}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-641172833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb49a837-6024-41cc-8666-3d014f0e2ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b664b2f64d4407b5f81429f744853c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:47Z,use_quota=True,user_id='c73368753bde4d7bb94c6acb34881cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Creating volume fb49a837-6024-41cc-8666-3d014f0e2ebd {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:58:47 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fb49a837-6024-41cc-8666-3d014f0e2ebd 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:47 devstack sudo[98958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fb49a837-6024-41cc-8666-3d014f0e2ebd 1073741824
Jul 14 17:58:47 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:47 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fb49a837-6024-41cc-8666-3d014f0e2ebd 1073741824" returned: 0 in 0.874s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fb49a837-6024-41cc-8666-3d014f0e2ebd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:48 devstack sudo[98971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fb49a837-6024-41cc-8666-3d014f0e2ebd
Jul 14 17:58:48 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:48 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fb49a837-6024-41cc-8666-3d014f0e2ebd" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:58:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aebfb94-1f34-45df-bf73-1b00258d9941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb49a837-6024-41cc-8666-3d014f0e2ebd', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859120ea-9951-48ed-ab82-4a1b964ef8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:48 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Volume volume-fb49a837-6024-41cc-8666-3d014f0e2ebd (fb49a837-6024-41cc-8666-3d014f0e2ebd): created successfully
Jul 14 17:58:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859120ea-9951-48ed-ab82-4a1b964ef8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Flow 'volume_create_manager' (5f8d7f39-3709-4073-9ffb-727ca7e67119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-85f795b6-9c2f-4d44-bd6c-7050e5c0b5b0 tempest-VolumesActionsTest-219961976 None] Created volume successfully.
Jul 14 17:58:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Acquiring lock "cinder-fb49a837-6024-41cc-8666-3d014f0e2ebd-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Lock "cinder-fb49a837-6024-41cc-8666-3d014f0e2ebd-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Acquiring lock "cinder-quobyte-fb49a837-6024-41cc-8666-3d014f0e2ebd" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Lock "cinder-quobyte-fb49a837-6024-41cc-8666-3d014f0e2ebd" acquired by "delete_volume" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46b6103-b9df-4e4c-8e57-db9691ff4df1]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fb49a837-6024-41cc-8666-3d014f0e2ebd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:49 devstack sudo[99008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fb49a837-6024-41cc-8666-3d014f0e2ebd
Jul 14 17:58:49 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:50 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fb49a837-6024-41cc-8666-3d014f0e2ebd" returned: 0 in 0.577s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fb49a837-6024-41cc-8666-3d014f0e2ebd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:50 devstack sudo[99039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fb49a837-6024-41cc-8666-3d014f0e2ebd
Jul 14 17:58:50 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:50 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fb49a837-6024-41cc-8666-3d014f0e2ebd" returned: 0 in 0.531s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Lock "cinder-quobyte-fb49a837-6024-41cc-8666-3d014f0e2ebd" released by "delete_volume" :: held 1.225s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:50 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Created reservations ['f46b28cf-4218-45ed-b4ce-588a09db2350', '06f57455-96c5-4b98-a41d-60a9b18230ab', '61be9224-a0d0-49c0-9526-7ce38b4fc07b', '0592d9df-b76a-4bad-9e91-1ff78c80baf1'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:58:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:51 devstack sudo[99054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:58:51 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:51 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:51 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:58:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Deleted volume successfully.
Jul 14 17:58:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b85cc7d0-46de-4581-a784-2fa98093daf1 tempest-VolumesActionsTest-2100406115 None] Lock "cinder-fb49a837-6024-41cc-8666-3d014f0e2ebd-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-9490bda0-4082-4041-a743-af3c3fbbe5e7 req-a84fc229-6181-4c44-a2ac-60bb58b015f8 tempest-TestShelveInstance-2129979753 None] Terminate volume connection completed successfully.
Jul 14 17:58:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-9490bda0-4082-4041-a743-af3c3fbbe5e7 req-a84fc229-6181-4c44-a2ac-60bb58b015f8 tempest-TestShelveInstance-2129979753 None] Deleting attachment 5fbd88fc-4e0b-4c57-9eb2-080dd9cdab10. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Flow 'volume_create_manager' (955626e2-c7d2-4502-b678-65f63366c186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a62e51e-e30b-42b0-bea2-b045badfb539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a62e51e-e30b-42b0-bea2-b045badfb539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1743473216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d41ef9-e4eb-4887-b8e0-d62e3575f6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b664b2f64d4407b5f81429f744853c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:53Z,use_quota=True,user_id='c73368753bde4d7bb94c6acb34881cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0946e5e-ba70-4d7d-a8d5-e0eb5174f202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0946e5e-ba70-4d7d-a8d5-e0eb5174f202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1ebcd2-4134-4202-ba22-005d3e33eeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1ebcd2-4134-4202-ba22-005d3e33eeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d41ef9-e4eb-4887-b8e0-d62e3575f6f8', 'volume_name': 'volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab74f62a-b9e5-441c-a542-c1c504299531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab74f62a-b9e5-441c-a542-c1c504299531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c5d51d-f618-4777-95f5-9a117dc3216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:53 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Volume 49d41ef9-e4eb-4887-b8e0-d62e3575f6f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8', 'volume_size': 1}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1743473216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d41ef9-e4eb-4887-b8e0-d62e3575f6f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b664b2f64d4407b5f81429f744853c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:53Z,use_quota=True,user_id='c73368753bde4d7bb94c6acb34881cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Creating volume 49d41ef9-e4eb-4887-b8e0-d62e3575f6f8 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:58:53 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:58:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:53 devstack sudo[99071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8 1073741824
Jul 14 17:58:53 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:54 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8 1073741824" returned: 0 in 0.910s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:54 devstack sudo[99083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8
Jul 14 17:58:54 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:54 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8" returned: 0 in 0.558s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:58:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c5d51d-f618-4777-95f5-9a117dc3216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc86d88d-da49-459e-8f2b-e108e1094037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:54 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Volume volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8 (49d41ef9-e4eb-4887-b8e0-d62e3575f6f8): created successfully
Jul 14 17:58:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc86d88d-da49-459e-8f2b-e108e1094037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Flow 'volume_create_manager' (955626e2-c7d2-4502-b678-65f63366c186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-be0e07bd-4663-42c6-b4dc-70f4616a7367 tempest-VolumesActionsTest-219961976 None] Created volume successfully.
Jul 14 17:58:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Acquiring lock "cinder-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Lock "cinder-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Acquiring lock "cinder-quobyte-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:58:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Lock "cinder-quobyte-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:58:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee1d1fe-1429-497b-ab4d-e2116feabd59]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:55 devstack sudo[99088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8
Jul 14 17:58:55 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:56 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8" returned: 0 in 0.720s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:56 devstack sudo[99093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8
Jul 14 17:58:56 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:56 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8" returned: 0 in 0.457s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Lock "cinder-quobyte-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8" released by "delete_volume" :: held 1.251s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:56 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Created reservations ['a134a64f-29da-4e50-a79d-94ccfd8a8eb6', 'e3020340-e67e-4bc3-87e6-3386258a97be', 'aedea8c2-c325-4887-97cb-2479ae65ea28', 'ca519f94-c5b7-4637-992a-22816eedd30d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:57 devstack sudo[99096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:58:57 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-b558ab81-b1f5-4859-ac27-f7e8bffef03d req-7a2ec574-ef72-4f04-a293-9a90940e27b9 tempest-TestShelveInstance-2129979753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-b558ab81-b1f5-4859-ac27-f7e8bffef03d req-7a2ec574-ef72-4f04-a293-9a90940e27b9 tempest-TestShelveInstance-2129979753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:57 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.585s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[877afe4d-3cf5-4737-9903-7736d18ffa0b]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-b558ab81-b1f5-4859-ac27-f7e8bffef03d req-7a2ec574-ef72-4f04-a293-9a90940e27b9 tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Deleted volume successfully.
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bdeec4d5-0bed-44a1-a28d-11bb3c3f9d37 tempest-VolumesActionsTest-2100406115 None] Lock "cinder-49d41ef9-e4eb-4887-b8e0-d62e3575f6f8-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:58:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:58:57 devstack sudo[99107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145
Jul 14 17:58:57 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Flow 'volume_create_manager' (91ceb5c2-5942-4758-9cac-f0e34292fde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444b4ba9-4c2e-425a-a415-e73095fb833f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444b4ba9-4c2e-425a-a415-e73095fb833f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1329555934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d91f1ad-23db-490c-97ab-e3662e09ab85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2870a8fb97944d13b50ceffe3fdf3e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:58Z,use_quota=True,user_id='2cd765ea027642caa7eda960dbfeb4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d8cffe-ade9-4777-b9db-41f607db8956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d8cffe-ade9-4777-b9db-41f607db8956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4da66be-7145-49c5-987f-b33ee951e121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4da66be-7145-49c5-987f-b33ee951e121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d91f1ad-23db-490c-97ab-e3662e09ab85', 'volume_name': 'volume-4d91f1ad-23db-490c-97ab-e3662e09ab85', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d841ff-7ad5-4a47-92f2-b65f2273a015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d841ff-7ad5-4a47-92f2-b65f2273a015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e47e75f-51d0-48dc-9e16-9581e3e680a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Volume 4d91f1ad-23db-490c-97ab-e3662e09ab85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d91f1ad-23db-490c-97ab-e3662e09ab85', 'volume_size': 1}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:58 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-b558ab81-b1f5-4859-ac27-f7e8bffef03d req-7a2ec574-ef72-4f04-a293-9a90940e27b9 tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145" returned: 0 in 0.546s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-b558ab81-b1f5-4859-ac27-f7e8bffef03d req-7a2ec574-ef72-4f04-a293-9a90940e27b9 tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:58 devstack sudo[99112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145
Jul 14 17:58:58 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Flow 'volume_create_manager' (ab6d8285-f5f7-4430-823a-e383810899f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b53972d-b5dc-4ec8-98ac-967e64face67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b53972d-b5dc-4ec8-98ac-967e64face67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1685532886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d9d403-7717-4e40-81a4-5dee6071b94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b664b2f64d4407b5f81429f744853c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:59Z,use_quota=True,user_id='c73368753bde4d7bb94c6acb34881cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ed1eb8-671c-426d-b899-2ae3ce992545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:59 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ed1eb8-671c-426d-b899-2ae3ce992545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eec0f59-d059-47b4-9509-2a42803a63d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eec0f59-d059-47b4-9509-2a42803a63d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d9d403-7717-4e40-81a4-5dee6071b94f', 'volume_name': 'volume-f5d9d403-7717-4e40-81a4-5dee6071b94f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d910ad-0e63-4eec-b233-e10ab78afd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d910ad-0e63-4eec-b233-e10ab78afd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210f4bbf-5db1-4fc1-82e4-dfbba376bb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:58:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Volume f5d9d403-7717-4e40-81a4-5dee6071b94f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d9d403-7717-4e40-81a4-5dee6071b94f', 'volume_size': 1}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-b558ab81-b1f5-4859-ac27-f7e8bffef03d req-7a2ec574-ef72-4f04-a293-9a90940e27b9 tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145" returned: 1 in 0.800s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-b558ab81-b1f5-4859-ac27-f7e8bffef03d req-7a2ec574-ef72-4f04-a293-9a90940e27b9 tempest-TestShelveInstance-2129979753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-b558ab81-b1f5-4859-ac27-f7e8bffef03d req-7a2ec574-ef72-4f04-a293-9a90940e27b9 tempest-TestShelveInstance-2129979753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.483s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.949s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1329555934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d91f1ad-23db-490c-97ab-e3662e09ab85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2870a8fb97944d13b50ceffe3fdf3e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:58Z,use_quota=True,user_id='2cd765ea027642caa7eda960dbfeb4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Creating volume 4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:58:59 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-b558ab81-b1f5-4859-ac27-f7e8bffef03d req-7a2ec574-ef72-4f04-a293-9a90940e27b9 tempest-TestShelveInstance-2129979753 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-da8909a9-22c5-4408-9fce-287d566e5145', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2845d6f1-7d43-4d03-87bd-fa650a63533f', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:58:59 devstack sudo[99118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85 1073741824
Jul 14 17:58:59 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:58:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-b558ab81-b1f5-4859-ac27-f7e8bffef03d req-7a2ec574-ef72-4f04-a293-9a90940e27b9 tempest-TestShelveInstance-2129979753 None] attachment_update completed successfully.
Jul 14 17:58:59 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root
Jul 14 17:58:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85 1073741824" returned: 0 in 0.908s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:00 devstack sudo[99125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85
Jul 14 17:59:00 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:00 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1685532886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d9d403-7717-4e40-81a4-5dee6071b94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b664b2f64d4407b5f81429f744853c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:58:59Z,use_quota=True,user_id='c73368753bde4d7bb94c6acb34881cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Creating volume f5d9d403-7717-4e40-81a4-5dee6071b94f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:59:00 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f5d9d403-7717-4e40-81a4-5dee6071b94f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e47e75f-51d0-48dc-9e16-9581e3e680a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d91f1ad-23db-490c-97ab-e3662e09ab85', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5c4222-575b-4d80-b7d4-efc5a8932f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Volume volume-4d91f1ad-23db-490c-97ab-e3662e09ab85 (4d91f1ad-23db-490c-97ab-e3662e09ab85): created successfully
Jul 14 17:59:00 devstack sudo[99128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f5d9d403-7717-4e40-81a4-5dee6071b94f 1073741824
Jul 14 17:59:00 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5c4222-575b-4d80-b7d4-efc5a8932f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Flow 'volume_create_manager' (91ceb5c2-5942-4758-9cac-f0e34292fde6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:59:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d868aba3-80cf-4a21-b29e-d6f8d8c45c1b tempest-SnapshotsActionsTest-1899176974 None] Created volume successfully.
Jul 14 17:59:01 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f5d9d403-7717-4e40-81a4-5dee6071b94f 1073741824" returned: 0 in 0.725s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f5d9d403-7717-4e40-81a4-5dee6071b94f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:01 devstack sudo[99133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f5d9d403-7717-4e40-81a4-5dee6071b94f
Jul 14 17:59:01 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:01 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f5d9d403-7717-4e40-81a4-5dee6071b94f" returned: 0 in 0.496s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.050s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210f4bbf-5db1-4fc1-82e4-dfbba376bb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d9d403-7717-4e40-81a4-5dee6071b94f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c377de34-2c4d-43bc-9c72-813ca5ac3c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] Creating offline snapshot d6a64dc3-e35e-4682-a46b-1cd1c464ad3d of volume 4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:59:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Volume volume-f5d9d403-7717-4e40-81a4-5dee6071b94f (f5d9d403-7717-4e40-81a4-5dee6071b94f): created successfully
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c377de34-2c4d-43bc-9c72-813ca5ac3c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Flow 'volume_create_manager' (ab6d8285-f5f7-4430-823a-e383810899f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f883d943-c412-4786-ad93-3cd82389797e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a1616534-8fc5-4b63-8769-22886d3de82d tempest-VolumesActionsTest-219961976 None] Created volume successfully.
Jul 14 17:59:02 devstack sudo[99136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85
Jul 14 17:59:02 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Acquiring lock "cinder-f5d9d403-7717-4e40-81a4-5dee6071b94f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Lock "cinder-f5d9d403-7717-4e40-81a4-5dee6071b94f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Acquiring lock "cinder-quobyte-f5d9d403-7717-4e40-81a4-5dee6071b94f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Lock "cinder-quobyte-f5d9d403-7717-4e40-81a4-5dee6071b94f" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[82974a79-4a8d-4ffd-a7d4-de14fb6bfc3a]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f5d9d403-7717-4e40-81a4-5dee6071b94f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:02 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85" returned: 0 in 0.842s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:02 devstack sudo[99143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d 1G
Jul 14 17:59:02 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:02 devstack sudo[99142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f5d9d403-7717-4e40-81a4-5dee6071b94f
Jul 14 17:59:02 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:03 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f5d9d403-7717-4e40-81a4-5dee6071b94f" returned: 0 in 0.694s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f5d9d403-7717-4e40-81a4-5dee6071b94f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:03 devstack sudo[99154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f5d9d403-7717-4e40-81a4-5dee6071b94f
Jul 14 17:59:03 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:03 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d 1G" returned: 0 in 0.824s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:03 devstack sudo[99156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:03 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:04 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f5d9d403-7717-4e40-81a4-5dee6071b94f" returned: 0 in 0.821s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Lock "cinder-quobyte-f5d9d403-7717-4e40-81a4-5dee6071b94f" released by "delete_volume" :: held 1.638s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:04 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Created reservations ['254ce90f-70ca-4ddc-bef2-024520ca5e30', '805673c9-b5bf-44a7-9ba5-e37c75d5e45a', '1735c52a-ac3a-4c91-adca-956a2b5b0a00', '27b498f5-818b-447f-ad85-bfbc4f39f7b1'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:04 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.937s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:04 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d is being set with open permissions: ugo+rw
Jul 14 17:59:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:04 devstack sudo[99199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:04 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:04 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:59:04 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:05 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.755s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:05 devstack sudo[99228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.info
Jul 14 17:59:05 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:05 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 1.218s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:05 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:59:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Deleted volume successfully.
Jul 14 17:59:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-70ef7abb-b98b-4a2d-a3b9-42e25a851bde tempest-VolumesActionsTest-2100406115 None] Lock "cinder-f5d9d403-7717-4e40-81a4-5dee6071b94f-delete_volume" released by "delete_volume" :: held 3.505s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:06 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.info" returned: 0 in 0.755s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:06 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.info is being set with open permissions: ugo+rw
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:06 devstack sudo[99236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.info
Jul 14 17:59:06 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Flow 'volume_create_manager' (7101a555-7856-4c04-9bb9-bf82716a969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed88a8d3-f5e7-4f31-b3fe-359af877a03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:06 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.info" returned: 0 in 0.673s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.179s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed88a8d3-f5e7-4f31-b3fe-359af877a03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1262815795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b664b2f64d4407b5f81429f744853c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:59:07Z,use_quota=True,user_id='c73368753bde4d7bb94c6acb34881cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2807d3f-5fe9-4a6d-81b4-d5096ccb1b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2807d3f-5fe9-4a6d-81b4-d5096ccb1b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96238a39-4a96-4c27-8825-d4cfd58254a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96238a39-4a96-4c27-8825-d4cfd58254a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6', 'volume_name': 'volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c775a5e-9ab6-4966-83b8-c87f20741b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c775a5e-9ab6-4966-83b8-c87f20741b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70d28e7-5b95-43a9-9003-1e82262b429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Volume 30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6', 'volume_size': 1}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1262815795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b664b2f64d4407b5f81429f744853c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:59:07Z,use_quota=True,user_id='c73368753bde4d7bb94c6acb34881cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Creating volume 30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:59:06 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:59:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:06 devstack sudo[99242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6 1073741824
Jul 14 17:59:06 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c2fb1319-66d2-4581-af2f-ad0f67c14bd3 tempest-SnapshotsActionsTest-1899176974 None] Create snapshot completed successfully
Jul 14 17:59:07 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6 1073741824" returned: 0 in 0.630s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:07 devstack sudo[99247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6
Jul 14 17:59:07 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:07 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:59:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70d28e7-5b95-43a9-9003-1e82262b429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94105e5-f895-4ebc-9aaf-b54ead2b5ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:07 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Volume volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6 (30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6): created successfully
Jul 14 17:59:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94105e5-f895-4ebc-9aaf-b54ead2b5ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Flow 'volume_create_manager' (7101a555-7856-4c04-9bb9-bf82716a969e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:59:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-307a804a-6205-441b-a706-c5d8a911dc0a tempest-VolumesActionsTest-219961976 None] Created volume successfully.
Jul 14 17:59:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] Creating offline snapshot 61922cb2-d2e5-4fc7-816c-7a047d8eb017 of volume 4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:59:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[71151658-63dd-43c1-9d97-6a22c5d4d860]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:09 devstack sudo[99250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:09 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:09 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.537s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:09 devstack sudo[99256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017 1G
Jul 14 17:59:09 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Acquiring lock "cinder-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Lock "cinder-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Acquiring lock "cinder-quobyte-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Lock "cinder-quobyte-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3e1315-b622-4e32-980b-099e348537c0]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:09 devstack sudo[99258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6
Jul 14 17:59:09 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:10 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017 1G" returned: 0 in 0.635s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:10 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6" returned: 0 in 0.450s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:10 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:10 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:10 devstack sudo[99270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6
Jul 14 17:59:10 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:10 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017" returned: 0 in 0.327s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:10 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017 is being set with open permissions: ugo+rw
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:10 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:10 devstack sudo[99277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017
Jul 14 17:59:10 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Lock "cinder-quobyte-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6" released by "delete_volume" :: held 0.877s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Created reservations ['d1646caa-2fd3-4dc3-814d-d97424f88c2e', '9c338f3a-264a-4f2a-9c16-70064a774089', '069e281e-06cc-4be4-971b-a9bd4cfb479a', '2df7b900-8e27-4d53-b345-a5ca2e44aa71'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:10 devstack sudo[99279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:59:10 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:10 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017" returned: 0 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7887ed5d-883f-4c1a-86bd-f57ecb2f81f8 tempest-SnapshotsActionsTest-1899176974 None] Create snapshot completed successfully
Jul 14 17:59:11 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.344s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:59:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Deleted volume successfully.
Jul 14 17:59:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5bae92ad-cfea-4ac7-a3ee-62c0ae7efbae tempest-VolumesActionsTest-219961976 None] Lock "cinder-30d4a16e-57fc-4c90-8fa9-d2d0d680f7d6-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Acquiring lock "cinder-61922cb2-d2e5-4fc7-816c-7a047d8eb017-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-61922cb2-d2e5-4fc7-816c-7a047d8eb017-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Acquiring lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Acquiring lock "cinder-quobyte-61922cb2-d2e5-4fc7-816c-7a047d8eb017" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-61922cb2-d2e5-4fc7-816c-7a047d8eb017" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Deleting offline snapshot 61922cb2-d2e5-4fc7-816c-7a047d8eb017 of volume 4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] snapshot_file for this snap is: volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d0294f-9be0-492f-90c1-991cea8600f5]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:12 devstack sudo[99284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017
Jul 14 17:59:12 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:12 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017" returned: 0 in 0.476s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[66434679-f411-4978-81e3-3dd17286182c]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:12 devstack sudo[99291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:12 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:13 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.408s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:13 devstack sudo[99296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017
Jul 14 17:59:13 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:13 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017" returned: 0 in 0.415s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:13 devstack sudo[99302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017
Jul 14 17:59:13 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:13 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.61922cb2-d2e5-4fc7-816c-7a047d8eb017" returned: 0 in 0.320s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-61922cb2-d2e5-4fc7-816c-7a047d8eb017" released by "_delete_snapshot" :: held 1.730s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" released by "delete_snapshot" :: held 1.767s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:14 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Created reservations ['dbd7d4ba-bc2b-4637-b7db-78926554217d', '05e8ad08-c6e7-4da2-8d4e-823921c1223c', '24bdf9c9-8a43-4e7f-bf9f-d2197c564fbf', '06ecd8e9-4dff-4f5e-aa92-4570a8f2f3d2'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Delete snapshot completed successfully.
Jul 14 17:59:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d62f518d-0abd-4324-9d6e-f987c0fbfdde tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-61922cb2-d2e5-4fc7-816c-7a047d8eb017-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:14 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=111,cinder:UPDATE=120,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:59:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] Creating offline snapshot 2f953f09-7c18-42a4-972e-e869b972e51d of volume 4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:59:14 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28a2f69-c043-475d-8533-645cb64b84b7]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:14 devstack sudo[99308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:14 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:15 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.421s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:15 devstack sudo[99313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d 1G
Jul 14 17:59:15 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:15 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d 1G" returned: 0 in 0.543s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:15 devstack sudo[99319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d
Jul 14 17:59:15 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:16 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:16 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d is being set with open permissions: ugo+rw
Jul 14 17:59:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:16 devstack sudo[99325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d
Jul 14 17:59:16 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:16 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.732s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b4119411-d107-4792-905d-29866d1f444f tempest-SnapshotsActionsTest-1899176974 None] Create snapshot completed successfully
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Acquiring lock "cinder-2f953f09-7c18-42a4-972e-e869b972e51d-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-2f953f09-7c18-42a4-972e-e869b972e51d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Acquiring lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Acquiring lock "cinder-quobyte-2f953f09-7c18-42a4-972e-e869b972e51d" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-2f953f09-7c18-42a4-972e-e869b972e51d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Deleting offline snapshot 2f953f09-7c18-42a4-972e-e869b972e51d of volume 4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] snapshot_file for this snap is: volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccf002c-f6c3-4e43-88f4-58d0694dde5d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:17 devstack sudo[99329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d
Jul 14 17:59:17 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:17 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d" returned: 0 in 0.452s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7fea48-8fc6-423f-b6d0-68d149472b00]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:17 devstack sudo[99334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:17 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:18 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.469s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:18 devstack sudo[99340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d
Jul 14 17:59:18 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:18 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d" returned: 0 in 0.700s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:18 devstack sudo[99346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d
Jul 14 17:59:18 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:19 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.2f953f09-7c18-42a4-972e-e869b972e51d" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-2f953f09-7c18-42a4-972e-e869b972e51d" released by "_delete_snapshot" :: held 2.042s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" released by "delete_snapshot" :: held 2.080s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:19 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Created reservations ['4ee224c2-6fc3-4b9f-8b34-137c931c42d4', 'd57423f8-1f3a-4bd8-a8c6-4c765baaedb9', '1a635c0d-cf81-446a-9279-c2507d847d55', 'b7ad445b-1967-4add-86e6-22279294dd12'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Delete snapshot completed successfully.
Jul 14 17:59:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d30038ee-c54f-4a33-9652-b927c7a188a0 tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-2f953f09-7c18-42a4-972e-e869b972e51d-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:59:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:20 devstack sudo[99355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:59:20 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] Creating offline snapshot 7a66c34b-6d6d-436c-aa9a-886047770de8 of volume 4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:59:21 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eac5d4-fb5c-45e3-9ef8-6ed4e8108f25]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:21 devstack sudo[99357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:21 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:21 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.441s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:59:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 17:59:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 17:59:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 17:59:21 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.468s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:21 devstack sudo[99366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8 1G
Jul 14 17:59:21 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7940e523-b2e7-4687-8038-0268ecb28f1b req-75461f87-76dd-4872-8095-3d197fee831f tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:22 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8 1G" returned: 0 in 0.693s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:22 devstack sudo[99380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8
Jul 14 17:59:22 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:22 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:22 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8 is being set with open permissions: ugo+rw
Jul 14 17:59:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:22 devstack sudo[99385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8
Jul 14 17:59:22 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:22 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8" returned: 0 in 0.240s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7940e523-b2e7-4687-8038-0268ecb28f1b req-75461f87-76dd-4872-8095-3d197fee831f tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.670s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bf7d87-59b1-4703-909d-26e97981e093]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7940e523-b2e7-4687-8038-0268ecb28f1b req-75461f87-76dd-4872-8095-3d197fee831f tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3daee1d4-4d94-4b7e-8c7d-65c1d455f995 tempest-SnapshotsActionsTest-1899176974 None] Create snapshot completed successfully
Jul 14 17:59:22 devstack sudo[99388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670
Jul 14 17:59:22 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:23 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7940e523-b2e7-4687-8038-0268ecb28f1b req-75461f87-76dd-4872-8095-3d197fee831f tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670" returned: 0 in 0.393s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7940e523-b2e7-4687-8038-0268ecb28f1b req-75461f87-76dd-4872-8095-3d197fee831f tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.420s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Acquiring lock "cinder-7a66c34b-6d6d-436c-aa9a-886047770de8-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-7a66c34b-6d6d-436c-aa9a-886047770de8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Acquiring lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-7940e523-b2e7-4687-8038-0268ecb28f1b req-75461f87-76dd-4872-8095-3d197fee831f tempest-TestInstancesWithCinderVolumes-1844393437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-1358b2b1-188a-450f-85da-b6c2f4fe5670', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '090d2597-250b-497c-b1fa-76ba6a92e836', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Acquiring lock "cinder-quobyte-7a66c34b-6d6d-436c-aa9a-886047770de8" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-7a66c34b-6d6d-436c-aa9a-886047770de8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Deleting offline snapshot 7a66c34b-6d6d-436c-aa9a-886047770de8 of volume 4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] snapshot_file for this snap is: volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0bd477-8a3d-4583-b296-ba716b2114cf]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-7940e523-b2e7-4687-8038-0268ecb28f1b req-75461f87-76dd-4872-8095-3d197fee831f tempest-TestInstancesWithCinderVolumes-1844393437 None] attachment_update completed successfully.
Jul 14 17:59:23 devstack sudo[99393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8
Jul 14 17:59:23 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:23 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8" returned: 0 in 0.462s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9976b6a2-1d42-405e-b83d-09ac11e62ec5]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:23 devstack sudo[99401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:23 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:24 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.468s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:24 devstack sudo[99406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8
Jul 14 17:59:24 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:24 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8" returned: 0 in 0.394s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:24 devstack sudo[99411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8
Jul 14 17:59:24 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:24 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.7a66c34b-6d6d-436c-aa9a-886047770de8" returned: 0 in 0.261s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-7a66c34b-6d6d-436c-aa9a-886047770de8" released by "_delete_snapshot" :: held 1.712s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" released by "delete_snapshot" :: held 1.743s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:25 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Created reservations ['c38104cb-a78e-4281-ae44-c6d56561185e', '39d4d4b4-94d9-4cba-b7d3-fe033a66a8f3', '0ab00270-3a6d-4674-9d23-ea1bc89383e3', '2b6a2714-4f61-4f20-accd-49c9d3ebc285'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Delete snapshot completed successfully.
Jul 14 17:59:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-101f18d6-1471-42d8-a932-468f256568bd tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-7a66c34b-6d6d-436c-aa9a-886047770de8-delete_snapshot" released by "delete_snapshot" :: held 1.898s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] Creating offline snapshot 555d39d0-bc31-46e4-87a5-97e93cb6c750 of volume 4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:59:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e54f2c3-6bdb-4913-9dd9-502c4fa8764b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:25 devstack sudo[99420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:25 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:26 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.460s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:26 devstack sudo[99431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750 1G
Jul 14 17:59:26 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-e26bf3a4-c329-4479-b227-0552692db423 req-50859d61-7134-4924-af7b-98a614f854e2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:26 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750 1G" returned: 0 in 0.481s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:26 devstack sudo[99442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750
Jul 14 17:59:26 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:27 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:27 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750 is being set with open permissions: ugo+rw
Jul 14 17:59:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:27 devstack sudo[99447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750
Jul 14 17:59:27 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:27 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.637s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-e26bf3a4-c329-4479-b227-0552692db423 req-50859d61-7134-4924-af7b-98a614f854e2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.886s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70107ee-068a-4d13-acd9-05a9e2193e40]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-e26bf3a4-c329-4479-b227-0552692db423 req-50859d61-7134-4924-af7b-98a614f854e2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7a37b979-ac61-4f4b-9f1f-0fb444b036bd tempest-SnapshotsActionsTest-1899176974 None] Create snapshot completed successfully
Jul 14 17:59:27 devstack sudo[99450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1
Jul 14 17:59:27 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:27 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-e26bf3a4-c329-4479-b227-0552692db423 req-50859d61-7134-4924-af7b-98a614f854e2 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1" returned: 0 in 0.393s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-e26bf3a4-c329-4479-b227-0552692db423 req-50859d61-7134-4924-af7b-98a614f854e2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.418s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-e26bf3a4-c329-4479-b227-0552692db423 req-50859d61-7134-4924-af7b-98a614f854e2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-e43faf0b-6649-4cfc-875a-0f196be9afb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8c4ef6c-2cd2-434a-9dac-8cc40eb92b9d', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 17:59:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-e26bf3a4-c329-4479-b227-0552692db423 req-50859d61-7134-4924-af7b-98a614f854e2 tempest-TestInstancesWithCinderVolumes-1844393437 None] attachment_update completed successfully.
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Acquiring lock "cinder-555d39d0-bc31-46e4-87a5-97e93cb6c750-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-555d39d0-bc31-46e4-87a5-97e93cb6c750-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Acquiring lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Acquiring lock "cinder-quobyte-555d39d0-bc31-46e4-87a5-97e93cb6c750" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-555d39d0-bc31-46e4-87a5-97e93cb6c750" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Deleting offline snapshot 555d39d0-bc31-46e4-87a5-97e93cb6c750 of volume 4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] snapshot_file for this snap is: volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5c0082-66f6-419d-981e-03b66d21be5e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:28 devstack sudo[99457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750
Jul 14 17:59:28 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:28 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750" returned: 0 in 0.437s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bf98b2-907b-4f51-8e09-12168b64a9ac]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:28 devstack sudo[99462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:28 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:29 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.441s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:29 devstack sudo[99467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750
Jul 14 17:59:29 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Flow 'volume_create_manager' (ce33e867-6d51-4f91-ac52-ff04bf079822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667a425a-1841-41eb-b271-33b7a907a527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667a425a-1841-41eb-b271-33b7a907a527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-807525507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176920ed-326d-49ba-a4d2-f80dbfb496b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d5230f721b47d59441969dae3ea7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:59:29Z,use_quota=True,user_id='b78d37113f5849218a90f2adc0fd5474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc378271-f5cb-425c-a866-cb28a5009278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc378271-f5cb-425c-a866-cb28a5009278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f450dae1-e296-45d9-8e70-783afc31557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 17:59:29 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750" returned: 0 in 0.537s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:29 devstack sudo[99474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750
Jul 14 17:59:29 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f450dae1-e296-45d9-8e70-783afc31557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '176920ed-326d-49ba-a4d2-f80dbfb496b7', 'volume_name': 'volume-176920ed-326d-49ba-a4d2-f80dbfb496b7', 'volume_size': 1, 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b35106125384bcf9ba800ba74e8254d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'created_at': datetime.datetime(2026, 7, 14, 15, 43, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 43, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3eef7b-9b54-4ea1-a240-6be757f56381/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2bfec5670>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8910026e-f0cb-4328-b0c6-4b7c834a26b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8910026e-f0cb-4328-b0c6-4b7c834a26b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f5c68e-2fdc-48d1-8511-085aa7e5ab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:29 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Volume 176920ed-326d-49ba-a4d2-f80dbfb496b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-176920ed-326d-49ba-a4d2-f80dbfb496b7', 'volume_size': 1, 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b35106125384bcf9ba800ba74e8254d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'created_at': datetime.datetime(2026, 7, 14, 15, 43, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 43, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3eef7b-9b54-4ea1-a240-6be757f56381/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2bfec5670>}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Trying to clone 176920ed-326d-49ba-a4d2-f80dbfb496b7 from image af3eef7b-9b54-4ea1-a240-6be757f56381 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 17:59:29 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.555d39d0-bc31-46e4-87a5-97e93cb6c750" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-555d39d0-bc31-46e4-87a5-97e93cb6c750" released by "_delete_snapshot" :: held 1.847s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" released by "delete_snapshot" :: held 1.884s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:30 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 17:59:30 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Image download 20.69 MB at 20.69 MB/s
Jul 14 17:59:30 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Created reservations ['7faca81e-0122-4fcc-80ec-29c6c5c8bace', '16cbc3c6-ff90-407f-8083-fa907c712f36', '56dbad3f-5094-4425-91bd-247e9669fc4d', 'fd7716fd-3de4-4610-a2d6-71efc18eda88'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[148eaa36-f565-47d8-88ab-43983459f42f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Delete snapshot completed successfully.
Jul 14 17:59:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ad8c11e2-3b65-4a23-9094-4808492e7f3d tempest-SnapshotsActionsTest-77034041 None] Lock "cinder-555d39d0-bc31-46e4-87a5-97e93cb6c750-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:30 devstack sudo[99486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD
Jul 14 17:59:30 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:30 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:30 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Temporary image af3eef7b-9b54-4ea1-a240-6be757f56381 is fetched for user b78d37113f5849218a90f2adc0fd5474. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 17:59:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[22633363-fa98-4f0b-9c34-d9ecfb697083]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:30 devstack sudo[99491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD
Jul 14 17:59:30 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:31 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-807525507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176920ed-326d-49ba-a4d2-f80dbfb496b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d5230f721b47d59441969dae3ea7c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:59:29Z,use_quota=True,user_id='b78d37113f5849218a90f2adc0fd5474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Creating volume 176920ed-326d-49ba-a4d2-f80dbfb496b7 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:59:31 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:31 devstack sudo[99496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 1073741824
Jul 14 17:59:31 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:31 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 1073741824" returned: 0 in 0.482s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:31 devstack sudo[99502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7
Jul 14 17:59:31 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "cinder-d6a64dc3-e35e-4682-a46b-1cd1c464ad3d-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Lock "cinder-d6a64dc3-e35e-4682-a46b-1cd1c464ad3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "cinder-quobyte-d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Lock "cinder-quobyte-d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Deleting offline snapshot d6a64dc3-e35e-4682-a46b-1cd1c464ad3d of volume 4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] snapshot_file for this snap is: volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06b16ea-8732-482d-a0be-67a0f3d5f2c8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:31 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Attempting download of af3eef7b-9b54-4ea1-a240-6be757f56381 ((None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}])) to volume 176920ed-326d-49ba-a4d2-f80dbfb496b7. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf768d9-4984-4695-8e2b-46f79da6f960]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_pf57gnut {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:31 devstack sudo[99507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:31 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:32 devstack sudo[99510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_pf57gnut
Jul 14 17:59:32 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:32 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.411s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d91f1ad-23db-490c-97ab-e3662e09ab85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e821fe1-5c00-4d6a-90d7-3d69b0c25142]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:32 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_pf57gnut" returned: 0 in 0.354s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_pf57gnut {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:32 devstack sudo[99526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85
Jul 14 17:59:32 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:32 devstack sudo[99527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_pf57gnut
Jul 14 17:59:32 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:32 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_pf57gnut" returned: 1 in 0.337s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_pf57gnut' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:59:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8644c88f-3e3b-4400-8899-c4738313bd8b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:32 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85" returned: 0 in 0.392s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:32 devstack sudo[99546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:32 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:32 devstack sudo[99543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD
Jul 14 17:59:32 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:33 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] af3eef7b-9b54-4ea1-a240-6be757f56381 was qcow2, converting to raw {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:33 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:33 devstack sudo[99558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7
Jul 14 17:59:33 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:33 devstack sudo[99560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d
Jul 14 17:59:33 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:33 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85.d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" returned: 0 in 0.279s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Lock "cinder-quobyte-d6a64dc3-e35e-4682-a46b-1cd1c464ad3d" released by "_delete_snapshot" :: held 1.599s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" released by "delete_snapshot" :: held 1.622s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Created reservations ['2f7b1251-f79a-41b1-af72-2c3636e5c02d', '96daa791-581b-4be1-9cb8-84e31496321f', 'f91872a0-e5f0-4a98-8088-eed5e19dbc7a', 'cc3cc9a4-c926-48a5-a2f8-92294dfd191c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-ae0ab3a4-b6a9-4b71-a8ac-f67dd747b5f3 req-bf02cee7-7a88-42be-8435-c332fc4f0f3b tempest-TestInstancesWithCinderVolumes-1844393437 None] Terminate volume connection completed successfully.
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-ae0ab3a4-b6a9-4b71-a8ac-f67dd747b5f3 req-bf02cee7-7a88-42be-8435-c332fc4f0f3b tempest-TestInstancesWithCinderVolumes-1844393437 None] Deleting attachment 090d2597-250b-497c-b1fa-76ba6a92e836. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:59:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Delete snapshot completed successfully.
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d04c2eca-bf6d-4eb5-b6fe-85382bc7abf8 tempest-SnapshotsActionsTest-1899176974 None] Lock "cinder-d6a64dc3-e35e-4682-a46b-1cd1c464ad3d-delete_snapshot" released by "delete_snapshot" :: held 1.805s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "cinder-4d91f1ad-23db-490c-97ab-e3662e09ab85-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Lock "cinder-4d91f1ad-23db-490c-97ab-e3662e09ab85-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[216f5548-a2b7-4d17-9533-b68e6b1696c3]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:34 devstack sudo[99571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85
Jul 14 17:59:34 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "cinder-1358b2b1-188a-450f-85da-b6c2f4fe5670-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "cinder-1358b2b1-188a-450f-85da-b6c2f4fe5670-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "cinder-quobyte-1358b2b1-188a-450f-85da-b6c2f4fe5670" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "cinder-quobyte-1358b2b1-188a-450f-85da-b6c2f4fe5670" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a795e46a-3094-400d-9e32-bd9f63721adc]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:34 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85" returned: 0 in 0.418s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:34 devstack sudo[99581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85
Jul 14 17:59:34 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:34 devstack sudo[99580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670
Jul 14 17:59:34 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:34 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7" returned: 0 in 1.645s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_2zgz7hdndevstack@QuobyteHD, size 112.00 MB, duration 1.65 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 17:59:34 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Converted 112.00 MB image at 68.00 MB/s
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:34 devstack sudo[99584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 1G
Jul 14 17:59:34 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:34 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4d91f1ad-23db-490c-97ab-e3662e09ab85" returned: 0 in 0.294s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Lock "cinder-quobyte-4d91f1ad-23db-490c-97ab-e3662e09ab85" released by "delete_volume" :: held 0.773s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Created reservations ['7aeee2ec-88a3-4a1d-9596-b4a9b35e74a8', '56b78f68-95af-4363-849e-4a3ad9ccd8c8', 'f238886d-6a00-457e-a9e9-28f9f33997d6', '721c42ae-7b1e-46c6-be4e-1d44df5a735a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:34 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670" returned: 0 in 0.429s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:34 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670
Jul 14 17:59:34 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:34 devstack sudo[99593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:59:34 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:35 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 1G" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df8417b-5614-48a5-b9f9-64aa35ee8717]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:35 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1358b2b1-188a-450f-85da-b6c2f4fe5670" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "cinder-quobyte-1358b2b1-188a-450f-85da-b6c2f4fe5670" released by "delete_volume" :: held 0.825s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:35 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.310s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:59:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Deleted volume successfully.
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ed76358d-54f4-49db-85b9-a5751a135ba6 tempest-SnapshotsActionsTest-1899176974 None] Lock "cinder-4d91f1ad-23db-490c-97ab-e3662e09ab85-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:35 devstack sudo[99598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7
Jul 14 17:59:35 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:35 devstack cinder-volume[87401]: WARNING cinder.quota [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2137318105-1162531228 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2137318105-1162531228, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:59:35 devstack cinder-volume[87401]: WARNING cinder.quota [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2137318105-1162531228 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2137318105-1162531228, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Created reservations ['137b322b-80d7-461c-8cb8-9052250db569', '904b372a-5d1c-44d7-8871-065c80beab68', '0da46b58-5659-4975-b76d-40abd1000118', '47092e23-03d9-48df-875a-91275b6b959c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:35 devstack sudo[99601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:59:35 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:35 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7" returned: 0 in 0.527s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:35 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:59:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Deleted volume successfully.
Jul 14 17:59:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e811e30b-f69b-4309-b7b5-ab02ee8853d2 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "cinder-1358b2b1-188a-450f-85da-b6c2f4fe5670-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:35 devstack sudo[99606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7
Jul 14 17:59:35 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:36 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7" returned: 1 in 0.432s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:59:36 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Downloaded image af3eef7b-9b54-4ea1-a240-6be757f56381 ((None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}])) to volume 176920ed-326d-49ba-a4d2-f80dbfb496b7 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 17:59:36 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Temporary image af3eef7b-9b54-4ea1-a240-6be757f56381 for user b78d37113f5849218a90f2adc0fd5474 is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 17:59:36 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Marking volume 176920ed-326d-49ba-a4d2-f80dbfb496b7 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 17:59:36 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Copying metadata from image af3eef7b-9b54-4ea1-a240-6be757f56381 to 176920ed-326d-49ba-a4d2-f80dbfb496b7. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 17:59:36 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Creating volume glance metadata for volume 176920ed-326d-49ba-a4d2-f80dbfb496b7 backed by image af3eef7b-9b54-4ea1-a240-6be757f56381 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 17:59:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f5c68e-2fdc-48d1-8511-085aa7e5ab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-176920ed-326d-49ba-a4d2-f80dbfb496b7', 'volume_size': 1, 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b35106125384bcf9ba800ba74e8254d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'created_at': datetime.datetime(2026, 7, 14, 15, 43, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 43, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3eef7b-9b54-4ea1-a240-6be757f56381/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2bfec5670>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceca87f8-1db9-4b33-8d53-e4c65a513c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:36 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Volume volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 (176920ed-326d-49ba-a4d2-f80dbfb496b7): created successfully
Jul 14 17:59:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceca87f8-1db9-4b33-8d53-e4c65a513c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Flow 'volume_create_manager' (ce33e867-6d51-4f91-ac52-ff04bf079822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:59:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-dab921c2-4888-4a89-9f6a-98da7af0d2b8 tempest-VolumesImageMetadata-639442031 None] Created volume successfully.
Jul 14 17:59:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Acquiring lock "cinder-176920ed-326d-49ba-a4d2-f80dbfb496b7-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Lock "cinder-176920ed-326d-49ba-a4d2-f80dbfb496b7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Acquiring lock "cinder-quobyte-176920ed-326d-49ba-a4d2-f80dbfb496b7" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Lock "cinder-quobyte-176920ed-326d-49ba-a4d2-f80dbfb496b7" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cce528-f6d8-453b-ac1a-5bab2367422f]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:37 devstack sudo[99640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7
Jul 14 17:59:37 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:37 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7" returned: 0 in 0.481s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:37 devstack sudo[99672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7
Jul 14 17:59:37 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:38 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7" returned: 1 in 0.475s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:38 devstack sudo[99677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7
Jul 14 17:59:38 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:38 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-176920ed-326d-49ba-a4d2-f80dbfb496b7" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Lock "cinder-quobyte-176920ed-326d-49ba-a4d2-f80dbfb496b7" released by "delete_volume" :: held 1.309s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-5de03a3a-30d0-4eb9-9de0-de9d73626c2b req-07fa02bb-d669-4b75-94ee-0182f930c525 tempest-TestInstancesWithCinderVolumes-1844393437 None] Terminate volume connection completed successfully.
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5de03a3a-30d0-4eb9-9de0-de9d73626c2b req-07fa02bb-d669-4b75-94ee-0182f930c525 tempest-TestInstancesWithCinderVolumes-1844393437 None] Deleting attachment e8c4ef6c-2cd2-434a-9dac-8cc40eb92b9d. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Created reservations ['645e4225-3ba6-4eca-b340-63ac87744650', 'a083e213-cfec-457f-9f9c-9f91aa6fab31', 'ebe24981-ed23-4725-aedc-f47bde4804d7', '1347ce3a-9568-4c32-9b55-73e1c9a1cf3d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:38 devstack sudo[99683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:59:38 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:39 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.272s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:39 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:59:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Deleted volume successfully.
Jul 14 17:59:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a9e9a93a-5354-4026-bf52-677f58730c06 tempest-VolumesImageMetadata-639442031 None] Lock "cinder-176920ed-326d-49ba-a4d2-f80dbfb496b7-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "cinder-e43faf0b-6649-4cfc-875a-0f196be9afb1-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "cinder-e43faf0b-6649-4cfc-875a-0f196be9afb1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "cinder-quobyte-e43faf0b-6649-4cfc-875a-0f196be9afb1" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "cinder-quobyte-e43faf0b-6649-4cfc-875a-0f196be9afb1" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:39 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc0a3ab-a666-4f06-adf4-e0089aba73ad]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:39 devstack sudo[99687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1
Jul 14 17:59:39 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:39 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1" returned: 0 in 0.471s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:40 devstack sudo[99693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1
Jul 14 17:59:40 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:40 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-e43faf0b-6649-4cfc-875a-0f196be9afb1" returned: 0 in 0.376s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "cinder-quobyte-e43faf0b-6649-4cfc-875a-0f196be9afb1" released by "delete_volume" :: held 0.909s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:40 devstack cinder-volume[87401]: WARNING cinder.quota [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2082885675-1254800486 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2082885675-1254800486, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:59:40 devstack cinder-volume[87401]: WARNING cinder.quota [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2082885675-1254800486 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2082885675-1254800486, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:59:40 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Created reservations ['50769287-bab1-4a9b-a6b3-4b75a2369aaa', '1acd71b1-a530-447f-8065-05a9ec64c8d8', '3f884d30-0ed4-41b7-9b12-8a33bd6575ee', '799ee8ff-d80d-456f-94ad-caec826a06e2'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:40 devstack sudo[99698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:59:40 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:41 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.467s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:41 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:59:41 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Deleted volume successfully.
Jul 14 17:59:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-16549f8a-a2ec-4b0e-9f6e-6fd2024f3d18 tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "cinder-e43faf0b-6649-4cfc-875a-0f196be9afb1-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:44 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-678b98e4-a243-410c-b857-2c8082bb3f4a req-688c466e-85c8-4fba-95e1-07025fb54441 tempest-TestInstancesWithCinderVolumes-1844393437 None] Terminate volume connection completed successfully.
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-678b98e4-a243-410c-b857-2c8082bb3f4a req-688c466e-85c8-4fba-95e1-07025fb54441 tempest-TestInstancesWithCinderVolumes-1844393437 None] Deleting attachment b87c6432-5b4e-4200-a458-60eaa94d3873. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Flow 'volume_create_manager' (3480cace-c5e7-49fa-b3dc-1d0f08cff6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a143fba1-4738-411f-b299-b0cd937df989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a143fba1-4738-411f-b299-b0cd937df989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1948681184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b28354-4c5e-4fcb-975e-b011bcf0afc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411f33c800ce4a499f1a61f9721d55e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:59:44Z,use_quota=True,user_id='d41ae2936cc94f109eacbb8cf9efeccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8537a3-9b6f-4343-852d-d59613abba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8537a3-9b6f-4343-852d-d59613abba84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496b0c17-38da-467c-9c71-801f5eabf184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496b0c17-38da-467c-9c71-801f5eabf184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b28354-4c5e-4fcb-975e-b011bcf0afc0', 'volume_name': 'volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c434456-84ed-483d-923e-8b875b946dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c434456-84ed-483d-923e-8b875b946dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a175226d-0f30-42f9-b3a7-2d429e6419e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:44 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Volume b2b28354-4c5e-4fcb-975e-b011bcf0afc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0', 'volume_size': 1}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1948681184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b28354-4c5e-4fcb-975e-b011bcf0afc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411f33c800ce4a499f1a61f9721d55e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:59:44Z,use_quota=True,user_id='d41ae2936cc94f109eacbb8cf9efeccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Creating volume b2b28354-4c5e-4fcb-975e-b011bcf0afc0 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:59:44 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:59:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:44 devstack sudo[99732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0 1073741824
Jul 14 17:59:44 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:45 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0 1073741824" returned: 0 in 0.846s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:45 devstack sudo[99740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0
Jul 14 17:59:45 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:45 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" returned: 0 in 0.313s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:59:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a175226d-0f30-42f9-b3a7-2d429e6419e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5b5d71-eeb1-4879-b87d-e7e1c47edb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:45 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Volume volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0 (b2b28354-4c5e-4fcb-975e-b011bcf0afc0): created successfully
Jul 14 17:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5b5d71-eeb1-4879-b87d-e7e1c47edb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Flow 'volume_create_manager' (3480cace-c5e7-49fa-b3dc-1d0f08cff6e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:59:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c3780b65-14ef-46f2-b6f6-87d0d024cb8a tempest-VolumesDeleteCascade-824967910 None] Created volume successfully.
Jul 14 17:59:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "cinder-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "cinder-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "cinder-quobyte-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "cinder-quobyte-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2e5daf-c0bc-408a-a612-2263dc776b56]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:46 devstack sudo[99761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b
Jul 14 17:59:46 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:46 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=129,cinder:UPDATE=120,cinder:INSERT=44,cinder:DELETE=10 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 17:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] Creating offline snapshot c765d26b-53dd-4132-8d83-6c475c70f4b1 of volume b2b28354-4c5e-4fcb-975e-b011bcf0afc0 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:59:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdf34cb-b1a1-4acc-a1db-8204e0d3fd6e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:46 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b" returned: 0 in 0.635s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:46 devstack sudo[99766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0
Jul 14 17:59:46 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:46 devstack sudo[99767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b
Jul 14 17:59:46 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:47 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" returned: 0 in 0.553s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:47 devstack sudo[99774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 1G
Jul 14 17:59:47 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:47 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b" returned: 1 in 0.655s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:47 devstack sudo[99779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b
Jul 14 17:59:47 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-5d1fb5c4-0a09-4581-964c-96ea7d9ac5bc tempest-TestShelveInstance-2129979753 None] Terminate volume connection completed successfully.
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-5d1fb5c4-0a09-4581-964c-96ea7d9ac5bc tempest-TestShelveInstance-2129979753 None] Deleting attachment 2845d6f1-7d43-4d03-87bd-fa650a63533f. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 17:59:47 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b" returned: 0 in 0.321s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "cinder-quobyte-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b" released by "delete_volume" :: held 1.703s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:47 devstack cinder-volume[87401]: WARNING cinder.quota [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-314895634-1558279396 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-314895634-1558279396, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:59:47 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:47 devstack cinder-volume[87401]: WARNING cinder.quota [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-314895634-1558279396 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-314895634-1558279396, it is now deprecated. Please use the default quota class for default quota.
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 1G" returned: 0 in 0.541s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Acquiring lock "cinder-da8909a9-22c5-4408-9fce-287d566e5145-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:47 devstack sudo[99787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1
Jul 14 17:59:47 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Lock "cinder-da8909a9-22c5-4408-9fce-287d566e5145-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Created reservations ['d6b18316-25be-4b82-9845-c60abe0c0052', '4a4a4f96-f175-40c1-81bc-9b44c8d25ccb', '1d68b4bb-1811-41dc-b732-2fa66f1dc124', 'd5a36de0-65e5-4e4e-abf3-773a6a711604'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Acquiring lock "cinder-quobyte-da8909a9-22c5-4408-9fce-287d566e5145" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Lock "cinder-quobyte-da8909a9-22c5-4408-9fce-287d566e5145" acquired by "delete_volume" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db3cb0e-043f-4701-92a9-fe7b6e0452b3]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:48 devstack sudo[99789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:59:48 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:48 devstack sudo[99791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145
Jul 14 17:59:48 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:48 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1" returned: 0 in 0.652s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:48 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 is being set with open permissions: ugo+rw
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:48 devstack sudo[99801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1
Jul 14 17:59:48 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:48 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.578s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:48 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145" returned: 0 in 0.563s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Deleted volume successfully.
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-85141dab-ac52-4f85-96b0-98ea7645f40a tempest-TestInstancesWithCinderVolumes-1844393437 None] Lock "cinder-d8d3eea4-bc89-4e3c-94bf-40d48be62e2b-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:48 devstack sudo[99803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145
Jul 14 17:59:48 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:48 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1" returned: 0 in 0.476s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:49 devstack sudo[99806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.info
Jul 14 17:59:49 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:49 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145" returned: 1 in 0.591s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:49 devstack sudo[99811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145
Jul 14 17:59:49 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:49 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.info" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:49 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.info is being set with open permissions: ugo+rw
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:49 devstack sudo[99814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.info
Jul 14 17:59:49 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:49 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-da8909a9-22c5-4408-9fce-287d566e5145" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Lock "cinder-quobyte-da8909a9-22c5-4408-9fce-287d566e5145" released by "delete_volume" :: held 1.624s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG cinder.quota [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Created reservations ['e8f6e0b8-eb1d-4600-8e1e-532fdb992867', 'b0c6be23-3b4b-496d-8ca7-51524939599c', '43996878-0cb4-4039-aa52-2b159ddf903a', 'cef379e3-bfc7-4cda-8086-3a41516aab42'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:49 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.info" returned: 0 in 0.320s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.018s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a6467ead-1720-4e3a-be99-0b70cb9e84a4 tempest-VolumesDeleteCascade-824967910 None] Create snapshot completed successfully
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:49 devstack sudo[99819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:59:49 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:50 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.manager [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:59:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Deleted volume successfully.
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [req-7b7e51a3-76dc-4c68-8294-a113d59f5a84 req-4a387a6a-3ef4-4848-926a-b3c9825a5cd3 tempest-TestShelveInstance-2129979753 None] Lock "cinder-da8909a9-22c5-4408-9fce-287d566e5145-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] Creating offline snapshot 6a9a8cac-df58-4cd9-8a85-d8eb873f0798 of volume b2b28354-4c5e-4fcb-975e-b011bcf0afc0 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[870a877f-bd5b-48b0-a466-29a207b6ce02]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:50 devstack sudo[99822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1
Jul 14 17:59:50 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Flow 'volume_create_manager' (4c9f63ec-8265-468f-9073-bd99f0d62d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29020d7-491a-4537-99b3-8b546ff9fdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29020d7-491a-4537-99b3-8b546ff9fdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-249179885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def3c00d-66c9-4b9c-805c-1e8a3b7a3d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62eae125aaf46a4a8b36d8f9c3bf0c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:59:51Z,use_quota=True,user_id='c49f8fa163ae4c0583e59eb1dcfdf55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e142246-cc2b-4e02-a7a4-68e7a1985560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e142246-cc2b-4e02-a7a4-68e7a1985560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6fffca-3c87-4243-91c4-29516a68d3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6fffca-3c87-4243-91c4-29516a68d3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'def3c00d-66c9-4b9c-805c-1e8a3b7a3d73', 'volume_name': 'volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:50 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d5d2fa-1f97-4724-b3d2-6548a63cac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d5d2fa-1f97-4724-b3d2-6548a63cac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d32a103-79c1-43e7-a772-6d59dce14df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Volume def3c00d-66c9-4b9c-805c-1e8a3b7a3d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73', 'volume_size': 1}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1" returned: 0 in 0.537s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:50 devstack sudo[99832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798 1G
Jul 14 17:59:50 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:51 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798 1G" returned: 0 in 0.491s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:51 devstack sudo[99838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798
Jul 14 17:59:51 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:51 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:51 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798 is being set with open permissions: ugo+rw
Jul 14 17:59:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:51 devstack sudo[99844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798
Jul 14 17:59:51 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:52 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798" returned: 0 in 0.348s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T15:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-249179885',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def3c00d-66c9-4b9c-805c-1e8a3b7a3d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62eae125aaf46a4a8b36d8f9c3bf0c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T15:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T15:59:51Z,use_quota=True,user_id='c49f8fa163ae4c0583e59eb1dcfdf55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Creating volume def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 17:59:52 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:52 devstack sudo[99849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 1073741824
Jul 14 17:59:52 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9ffdd9e9-39c6-40c3-8145-3116c960584d tempest-VolumesDeleteCascade-824967910 None] Create snapshot completed successfully
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-b2b28354-4c5e-4fcb-975e-b011bcf0afc0-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-b2b28354-4c5e-4fcb-975e-b011bcf0afc0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Performing cascade delete. {{(pid=87401) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-6a9a8cac-df58-4cd9-8a85-d8eb873f0798-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-6a9a8cac-df58-4cd9-8a85-d8eb873f0798-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-quobyte-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-quobyte-6a9a8cac-df58-4cd9-8a85-d8eb873f0798" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-6a9a8cac-df58-4cd9-8a85-d8eb873f0798" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Deleting offline snapshot 6a9a8cac-df58-4cd9-8a85-d8eb873f0798 of volume b2b28354-4c5e-4fcb-975e-b011bcf0afc0 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:59:52 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] snapshot_file for this snap is: volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 1073741824" returned: 0 in 0.534s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f77209-7fed-427a-8193-c2083aafcbaa]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:52 devstack sudo[99857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73
Jul 14 17:59:52 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:52 devstack sudo[99856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798
Jul 14 17:59:52 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:53 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d32a103-79c1-43e7-a772-6d59dce14df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb71c7d-38c8-4354-aa99-f197c95e9bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 17:59:53 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Volume volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 (def3c00d-66c9-4b9c-805c-1e8a3b7a3d73): created successfully
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb71c7d-38c8-4354-aa99-f197c95e9bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Flow 'volume_create_manager' (4c9f63ec-8265-468f-9073-bd99f0d62d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 17:59:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c20958a0-b2ca-46cf-b7d4-73a4602bfdb8 tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Created volume successfully.
Jul 14 17:59:53 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798" returned: 0 in 0.505s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cebe4b-50d1-471d-80b8-aa4383711f67]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:53 devstack sudo[99864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1
Jul 14 17:59:53 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:53 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1" returned: 0 in 0.531s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:53 devstack sudo[99875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798
Jul 14 17:59:53 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:54 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798" returned: 0 in 0.592s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:54 devstack sudo[99880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798
Jul 14 17:59:54 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Creating offline snapshot c6576ede-4b3e-47c9-a9db-936b9cbba4a2 of volume def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eadd8a-4833-4365-bdb7-2efd2f1d87f2]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:54 devstack sudo[99882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73
Jul 14 17:59:54 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:54 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.6a9a8cac-df58-4cd9-8a85-d8eb873f0798" returned: 0 in 0.332s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-6a9a8cac-df58-4cd9-8a85-d8eb873f0798" released by "_delete_snapshot" :: held 2.092s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" released by "delete_snapshot" :: held 2.122s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Created reservations ['b0ae4e4b-d7bc-482c-9653-3957db627895', 'd37460a4-fd5d-4236-a6b4-ec978488764e', 'c4181bcf-9f6a-4661-a842-acb939e65cdb', 'cc39deb0-3e7f-436f-8741-e32123dd551f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:54 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73" returned: 0 in 0.574s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Delete snapshot completed successfully.
Jul 14 17:59:55 devstack sudo[99890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2 1G
Jul 14 17:59:55 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-6a9a8cac-df58-4cd9-8a85-d8eb873f0798-delete_snapshot" released by "delete_snapshot" :: held 2.452s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-c765d26b-53dd-4132-8d83-6c475c70f4b1-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-c765d26b-53dd-4132-8d83-6c475c70f4b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-quobyte-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-quobyte-c765d26b-53dd-4132-8d83-6c475c70f4b1" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-c765d26b-53dd-4132-8d83-6c475c70f4b1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Deleting offline snapshot c765d26b-53dd-4132-8d83-6c475c70f4b1 of volume b2b28354-4c5e-4fcb-975e-b011bcf0afc0 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] snapshot_file for this snap is: volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0541ef0e-b0e9-4f61-a4a7-5f99d36fba76]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:55 devstack sudo[99892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1
Jul 14 17:59:55 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:55 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2 1G" returned: 0 in 0.568s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:55 devstack sudo[99899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2
Jul 14 17:59:55 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:55 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1" returned: 0 in 0.450s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19d5494-8f6d-4621-a0f6-8e7845622136]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:55 devstack sudo[99902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0
Jul 14 17:59:55 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:55 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2" returned: 0 in 0.373s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:55 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2 is being set with open permissions: ugo+rw
Jul 14 17:59:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:55 devstack sudo[99908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2
Jul 14 17:59:55 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:56 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" returned: 0 in 0.497s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:56 devstack sudo[99913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1
Jul 14 17:59:56 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:56 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:56 devstack sudo[99916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.info
Jul 14 17:59:56 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:56 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.info" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:56 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.info is being set with open permissions: ugo+rw
Jul 14 17:59:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:56 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1" returned: 0 in 0.424s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:56 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.info
Jul 14 17:59:56 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:56 devstack sudo[99924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1
Jul 14 17:59:56 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:56 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.info" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:56 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.577s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0.c765d26b-53dd-4132-8d83-6c475c70f4b1" returned: 0 in 0.337s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-c765d26b-53dd-4132-8d83-6c475c70f4b1" released by "_delete_snapshot" :: held 1.880s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" released by "delete_snapshot" :: held 1.938s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d25051dc-f647-4fc2-8b62-d62188302b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Create snapshot completed successfully
Jul 14 17:59:57 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Created reservations ['437a2029-b5eb-46f4-9944-620959d71183', '636b487f-c776-415c-99ff-f8a93f0a1d28', '686abb2c-4a75-4e04-821d-fbc510d895b5', '42bd244c-10ef-4c56-8fee-1ededc30ae82'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Delete snapshot completed successfully.
Jul 14 17:59:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-c765d26b-53dd-4132-8d83-6c475c70f4b1-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Snapshots deleted, issuing volume delete {{(pid=87401) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 14 17:59:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-quobyte-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:57 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2152409c-db37-477c-a464-40129b1be09b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:57 devstack sudo[99931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0
Jul 14 17:59:57 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:57 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" returned: 0 in 0.420s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:57 devstack sudo[99936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0
Jul 14 17:59:57 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:58 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" returned: 0 in 0.339s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-b2b28354-4c5e-4fcb-975e-b011bcf0afc0" released by "delete_volume" :: held 0.847s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Acquiring lock "cinder-c6576ede-4b3e-47c9-a9db-936b9cbba4a2-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "cinder-c6576ede-4b3e-47c9-a9db-936b9cbba4a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Acquiring lock "cinder-quobyte-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Created reservations ['c85f25ea-31b3-4a0d-9813-95e74a29097d', 'fc05ad9c-34ab-45af-87fc-6c7cd2db5917', 'fa3a7f57-4259-4668-b596-e82425fe4c4b', '1f7f71b3-161a-4ceb-b92d-ec6c916b8ea4'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "cinder-quobyte-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Acquiring lock "cinder-quobyte-c6576ede-4b3e-47c9-a9db-936b9cbba4a2" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "cinder-quobyte-c6576ede-4b3e-47c9-a9db-936b9cbba4a2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Deleting offline snapshot c6576ede-4b3e-47c9-a9db-936b9cbba4a2 of volume def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] snapshot_file for this snap is: volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf381e0-b0a0-415c-a071-cb8e9de298ca]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:58 devstack sudo[99940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 17:59:58 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:58 devstack sudo[99939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2
Jul 14 17:59:58 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:58 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.437s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 17:59:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Deleted volume successfully.
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6cb4cdf3-db70-43e7-9d7d-891840a09888 tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-b2b28354-4c5e-4fcb-975e-b011bcf0afc0-delete_volume" released by "delete_volume" :: held 6.372s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 17:59:58 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2" returned: 0 in 0.564s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd23f1da-4336-46ca-b0a6-c3848abec459]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 17:59:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:59 devstack sudo[99949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73
Jul 14 17:59:59 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:59 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73" returned: 0 in 0.509s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 17:59:59 devstack sudo[99956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2
Jul 14 17:59:59 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 17:59:59 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root
Jul 14 17:59:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2" returned: 0 in 0.578s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 17:59:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:00 devstack sudo[99964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2
Jul 14 18:00:00 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Flow 'volume_create_manager' (f15a0813-ddfb-4884-a320-d8978f6efe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72570c2f-d97c-439f-a9cf-6c55027adff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72570c2f-d97c-439f-a9cf-6c55027adff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1829830002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411f33c800ce4a499f1a61f9721d55e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:00Z,use_quota=True,user_id='d41ae2936cc94f109eacbb8cf9efeccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d83ff6b-98f8-4640-8329-f01039b61f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d83ff6b-98f8-4640-8329-f01039b61f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603d31bb-4572-4fc2-8856-93ddf1fe1a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603d31bb-4572-4fc2-8856-93ddf1fe1a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c', 'volume_name': 'volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d980a4-8fdd-4f75-adfc-d4b147a5a8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d980a4-8fdd-4f75-adfc-d4b147a5a8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297d13ae-e0ae-4eb8-bf2c-f7ef0dd3098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Volume ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c', 'volume_size': 1}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1829830002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411f33c800ce4a499f1a61f9721d55e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:00Z,use_quota=True,user_id='d41ae2936cc94f109eacbb8cf9efeccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Creating volume ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:00 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:00 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73.c6576ede-4b3e-47c9-a9db-936b9cbba4a2" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:00 devstack sudo[99967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c 1073741824
Jul 14 18:00:00 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "cinder-quobyte-c6576ede-4b3e-47c9-a9db-936b9cbba4a2" released by "_delete_snapshot" :: held 2.121s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "cinder-quobyte-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73" released by "delete_snapshot" :: held 2.155s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Created reservations ['757fb59f-8d74-433e-ac83-bc38bc205d9e', 'e4d6b7b3-805f-4967-97f8-fcaf6e410617', '295ed8a9-419f-4b10-a5ad-22ba14f7b37f', '6bacb25f-f6af-4c7f-888f-3991b22b7500'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Delete snapshot completed successfully.
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-62f6e0b0-52b2-49b2-9276-d33f1693e73d tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "cinder-c6576ede-4b3e-47c9-a9db-936b9cbba4a2-delete_snapshot" released by "delete_snapshot" :: held 2.398s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:00 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c 1073741824" returned: 0 in 0.580s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:00 devstack sudo[99973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c
Jul 14 18:00:00 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:01 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297d13ae-e0ae-4eb8-bf2c-f7ef0dd3098a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00aebf0-10a7-4c94-a68a-0ace21e96c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Volume volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c (ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c): created successfully
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00aebf0-10a7-4c94-a68a-0ace21e96c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Flow 'volume_create_manager' (f15a0813-ddfb-4884-a320-d8978f6efe85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4583aae7-5471-4730-8e85-5eeaedb60018 tempest-VolumesDeleteCascade-824967910 None] Created volume successfully.
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Acquiring lock "cinder-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "cinder-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Acquiring lock "cinder-quobyte-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "cinder-quobyte-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe45ad89-c446-414b-8f31-7924945ab86a]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:01 devstack sudo[99976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73
Jul 14 18:00:01 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:02 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73" returned: 0 in 0.490s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:02 devstack sudo[99981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73
Jul 14 18:00:02 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] Creating offline snapshot 73faff8f-b7a3-442a-8a53-45da24112845 of volume ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad4c3a3-7666-48aa-8539-6554823282bc]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:02 devstack sudo[99983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c
Jul 14 18:00:02 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:02 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "cinder-quobyte-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73" released by "delete_volume" :: held 0.980s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Created reservations ['178203e4-038d-4c2f-acb7-006c25f2c2f0', 'fd3e6503-e592-4700-a4ed-129c55af1a91', '4d4952df-668d-4db8-96f0-5b84419ae096', '7909bd26-803f-4121-988f-39ce0746d80c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:02 devstack sudo[99988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:02 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:02 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" returned: 0 in 0.481s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:02 devstack sudo[99992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845 1G
Jul 14 18:00:02 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:03 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:03 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Deleted volume successfully.
Jul 14 18:00:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e59debfb-93a1-4445-827c-eacc08c0d96a tempest-VolumeSnapshotQuotasNegativeTestJSON-649136345 None] Lock "cinder-def3c00d-66c9-4b9c-805c-1e8a3b7a3d73-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:03 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845 1G" returned: 0 in 0.502s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:03 devstack sudo[99999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845
Jul 14 18:00:03 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:03 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:03 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845 is being set with open permissions: ugo+rw
Jul 14 18:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:03 devstack sudo[100004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845
Jul 14 18:00:03 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:03 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845" returned: 0 in 0.306s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:04 devstack sudo[100007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.info
Jul 14 18:00:04 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Flow 'volume_create_manager' (a3a6b53f-cc2e-44e0-a45e-7fa29b1fc4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8b49a1-897e-4200-ab56-3f5c359d1ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8b49a1-897e-4200-ab56-3f5c359d1ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-921238331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb9fe1b-bfa8-4e1c-a68d-34f3f757640d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9d2a16ee43455cbf06494e0d0f5499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:04Z,use_quota=True,user_id='400b56cdd58b4b08af909723bb15b086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5871f9e8-cdc0-4310-8869-54f207116e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5871f9e8-cdc0-4310-8869-54f207116e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eeeed9f-5e12-4ab6-81ad-12b7cf50ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eeeed9f-5e12-4ab6-81ad-12b7cf50ef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb9fe1b-bfa8-4e1c-a68d-34f3f757640d', 'volume_name': 'volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57060549-7f93-4847-8086-15d8fce5e34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57060549-7f93-4847-8086-15d8fce5e34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34663cf-c6eb-4e63-a8ed-3ad00fa45591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume beb9fe1b-bfa8-4e1c-a68d-34f3f757640d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d', 'volume_size': 1}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:04 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.info" returned: 0 in 0.330s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:04 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.info is being set with open permissions: ugo+rw
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:04 devstack sudo[100010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.info
Jul 14 18:00:04 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Flow 'volume_create_manager' (30f389ff-dab4-4f41-a88c-defd0f6ddd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495b499d-caad-432d-b93f-af9ab7ce6f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495b499d-caad-432d-b93f-af9ab7ce6f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-659150706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7da920-c8a8-4988-a688-7dfda4d2ab0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9820935477f14883a06bcf3b7334bdb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:04Z,use_quota=True,user_id='7ed958d2d7e743798ed28518fba37a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4620148b-d243-4647-b3ab-5d4de7f6c9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4620148b-d243-4647-b3ab-5d4de7f6c9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70df2953-434a-4932-944f-c99b33f8c239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70df2953-434a-4932-944f-c99b33f8c239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7da920-c8a8-4988-a688-7dfda4d2ab0c', 'volume_name': 'volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3c92c9-5791-48bb-a33e-07900805b0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3c92c9-5791-48bb-a33e-07900805b0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0531de42-9428-4933-b26b-6715df20c99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Volume 3b7da920-c8a8-4988-a688-7dfda4d2ab0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c', 'volume_size': 1}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:04 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.info" returned: 0 in 0.276s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-921238331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb9fe1b-bfa8-4e1c-a68d-34f3f757640d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9d2a16ee43455cbf06494e0d0f5499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:04Z,use_quota=True,user_id='400b56cdd58b4b08af909723bb15b086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Creating volume beb9fe1b-bfa8-4e1c-a68d-34f3f757640d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:04 devstack sudo[100013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d 1073741824
Jul 14 18:00:04 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ff728a4e-50ad-4463-a36c-b743ff6bc8b9 tempest-VolumesDeleteCascade-824967910 None] Create snapshot completed successfully
Jul 14 18:00:05 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d 1073741824" returned: 0 in 0.478s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:05 devstack sudo[100019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d
Jul 14 18:00:05 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:05 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d" returned: 0 in 0.286s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-659150706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7da920-c8a8-4988-a688-7dfda4d2ab0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9820935477f14883a06bcf3b7334bdb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:04Z,use_quota=True,user_id='7ed958d2d7e743798ed28518fba37a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Creating volume 3b7da920-c8a8-4988-a688-7dfda4d2ab0c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:05 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34663cf-c6eb-4e63-a8ed-3ad00fa45591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:05 devstack sudo[100023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c 1073741824
Jul 14 18:00:05 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5c7256-73a0-4d80-9fa1-98107bc257c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d (beb9fe1b-bfa8-4e1c-a68d-34f3f757640d): created successfully
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5c7256-73a0-4d80-9fa1-98107bc257c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Flow 'volume_create_manager' (a3a6b53f-cc2e-44e0-a45e-7fa29b1fc4ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8bfe2dc4-1c45-4265-a15e-27500d599808 tempest-CreateVolumesFromSnapshotTest-263665741 None] Created volume successfully.
Jul 14 18:00:06 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c 1073741824" returned: 0 in 0.606s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:06 devstack sudo[100030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Flow 'volume_create_manager' (07635c7d-c755-4295-a738-8001bcec2896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:06 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6430a721-a3bb-490d-911c-4a3b973769ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6430a721-a3bb-490d-911c-4a3b973769ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1092979048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691c9bc6-0928-4e20-b3d4-f47423fbdd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411f33c800ce4a499f1a61f9721d55e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=73faff8f-b7a3-442a-8a53-45da24112845,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:06Z,use_quota=True,user_id='d41ae2936cc94f109eacbb8cf9efeccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c88dee0-8808-4f7f-afee-14dfde945188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c88dee0-8808-4f7f-afee-14dfde945188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88baca83-3327-48ef-988d-60f523d8c043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88baca83-3327-48ef-988d-60f523d8c043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '691c9bc6-0928-4e20-b3d4-f47423fbdd44', 'volume_name': 'volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44', 'volume_size': 1, 'snapshot_id': '73faff8f-b7a3-442a-8a53-45da24112845'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3ece91-89c4-4fcd-ab4d-9a6e9fcff9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3ece91-89c4-4fcd-ab4d-9a6e9fcff9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2716665-1505-43d8-808e-b1c0725326a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Volume 691c9bc6-0928-4e20-b3d4-f47423fbdd44: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44', 'volume_size': 1, 'snapshot_id': '73faff8f-b7a3-442a-8a53-45da24112845'}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:06 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.191s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-quobyte-73faff8f-b7a3-442a-8a53-45da24112845-691c9bc6-0928-4e20-b3d4-f47423fbdd44" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0531de42-9428-4933-b26b-6715df20c99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e145d5a-16eb-4997-b4a8-2b8d575194de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-73faff8f-b7a3-442a-8a53-45da24112845-691c9bc6-0928-4e20-b3d4-f47423fbdd44" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Creating volume 691c9bc6-0928-4e20-b3d4-f47423fbdd44 from snapshot 73faff8f-b7a3-442a-8a53-45da24112845 {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-quobyte-691c9bc6-0928-4e20-b3d4-f47423fbdd44" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Volume volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c (3b7da920-c8a8-4988-a688-7dfda4d2ab0c): created successfully
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e145d5a-16eb-4997-b4a8-2b8d575194de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Flow 'volume_create_manager' (30f389ff-dab4-4f41-a88c-defd0f6ddd62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-691c9bc6-0928-4e20-b3d4-f47423fbdd44" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] snapshot: 73faff8f-b7a3-442a-8a53-45da24112845, volume: 691c9bc6-0928-4e20-b3d4-f47423fbdd44,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 18:00:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2f834e42-cd24-48f6-9a63-6b4e923ef7b8 tempest-VolumeDependencyTests-366073106 None] Created volume successfully.
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[26be5bbc-b33c-4726-bd6d-5b83d59aaad9]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:06 devstack sudo[100033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845
Jul 14 18:00:06 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:07 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845" returned: 0 in 0.376s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:00:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 18:00:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 18:00:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1963c101-4698-44cf-ad8b-c5942027ccf7]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:07 devstack sudo[100039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c
Jul 14 18:00:07 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:07 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" returned: 0 in 0.367s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:07 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Path /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 18:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:07 devstack sudo[100044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44
Jul 14 18:00:07 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:12 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44" returned: 0 in 4.659s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaecf23-cad9-4396-83d0-e6a85291f74b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:12 devstack sudo[100059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c
Jul 14 18:00:12 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:12 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" returned: 0 in 0.514s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:00:12 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Converted 1024.00 MB image at 219.75 MB/s
Jul 14 18:00:12 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44 is being set with open permissions: ugo+rw
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:12 devstack sudo[100064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44
Jul 14 18:00:12 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:12 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44" returned: 0 in 0.255s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-691c9bc6-0928-4e20-b3d4-f47423fbdd44" released by "_copy_volume_from_snapshot" :: held 6.279s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-73faff8f-b7a3-442a-8a53-45da24112845-691c9bc6-0928-4e20-b3d4-f47423fbdd44" released by "_create_volume_from_snapshot" :: held 6.320s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.360s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.487s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] Creating offline snapshot 97abca17-0b47-494a-91cb-83f9103d43b6 of volume beb9fe1b-bfa8-4e1c-a68d-34f3f757640d {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2716665-1505-43d8-808e-b1c0725326a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44', 'volume_size': 1, 'snapshot_id': '73faff8f-b7a3-442a-8a53-45da24112845'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1a6dfa-3cc6-492b-aed3-3586af0a0e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2ef2d7-dada-43de-abd8-f1613d1ec63b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:12 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Volume volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44 (691c9bc6-0928-4e20-b3d4-f47423fbdd44): created successfully
Jul 14 18:00:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1a6dfa-3cc6-492b-aed3-3586af0a0e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Flow 'volume_create_manager' (07635c7d-c755-4295-a738-8001bcec2896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-de822fbe-03a4-4264-93e9-c907bdd0c94d tempest-VolumesDeleteCascade-824967910 None] Created volume successfully.
Jul 14 18:00:13 devstack sudo[100067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d
Jul 14 18:00:13 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:13 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d" returned: 0 in 0.403s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:13 devstack sudo[100072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6 1G
Jul 14 18:00:13 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:13 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6 1G" returned: 0 in 0.456s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:13 devstack sudo[100077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6
Jul 14 18:00:13 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Performing cascade delete. {{(pid=87401) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-73faff8f-b7a3-442a-8a53-45da24112845-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-73faff8f-b7a3-442a-8a53-45da24112845-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-quobyte-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-quobyte-73faff8f-b7a3-442a-8a53-45da24112845" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-73faff8f-b7a3-442a-8a53-45da24112845" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Deleting offline snapshot 73faff8f-b7a3-442a-8a53-45da24112845 of volume ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] snapshot_file for this snap is: volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f48e3fa-e56d-4f07-9b33-ea3df030d1b8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:14 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6" returned: 0 in 0.392s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:14 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6 is being set with open permissions: ugo+rw
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:14 devstack sudo[100085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6
Jul 14 18:00:14 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:14 devstack sudo[100084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845
Jul 14 18:00:14 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:14 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6" returned: 0 in 0.279s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:14 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845" returned: 0 in 0.422s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:00:14 devstack sudo[100093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.info
Jul 14 18:00:14 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe48636-5f63-4e3a-b89d-bef13da2d742]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:14 devstack sudo[100095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c
Jul 14 18:00:14 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:14 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.info" returned: 0 in 0.297s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:14 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.info is being set with open permissions: ugo+rw
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:14 devstack sudo[100098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.info
Jul 14 18:00:14 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:14 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" returned: 0 in 0.396s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:15 devstack sudo[100103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845
Jul 14 18:00:15 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:15 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.info" returned: 0 in 0.297s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.373s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=138,cinder:DELETE=14,cinder:INSERT=35,cinder:UPDATE=135 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] Creating offline snapshot 33ee2d33-281c-4164-8920-783933df1df4 of volume 3b7da920-c8a8-4988-a688-7dfda4d2ab0c {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:00:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c936e303-3028-4faf-b332-69ce402cb801 tempest-CreateVolumesFromSnapshotTest-263665741 None] Create snapshot completed successfully
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[002e9477-8064-44d9-9d9e-311081e36a5b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:15 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845" returned: 0 in 0.370s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:15 devstack sudo[100109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c
Jul 14 18:00:15 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:15 devstack sudo[100110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845
Jul 14 18:00:15 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:15 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c.73faff8f-b7a3-442a-8a53-45da24112845" returned: 0 in 0.257s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:15 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" returned: 0 in 0.402s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-73faff8f-b7a3-442a-8a53-45da24112845" released by "_delete_snapshot" :: held 1.556s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" released by "delete_snapshot" :: held 1.590s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:15 devstack sudo[100117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4 1G
Jul 14 18:00:15 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Created reservations ['62a99db8-d30f-4bde-bb5f-1fdbb8d06a4a', '215f0481-f8d8-4437-8c86-b9c5e4a187a3', '0efd72af-c059-4782-adb4-444af0039755', '06cfd856-71e3-4141-92dd-832e05ea5790'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Delete snapshot completed successfully.
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-73faff8f-b7a3-442a-8a53-45da24112845-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Snapshots deleted, issuing volume delete {{(pid=87401) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-quobyte-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e345973-e85b-498c-8d3e-136b43473c47]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:15 devstack sudo[100119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c
Jul 14 18:00:15 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:16 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4 1G" returned: 0 in 0.549s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:16 devstack sudo[100124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4
Jul 14 18:00:16 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:16 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" returned: 0 in 0.478s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:16 devstack sudo[100129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c
Jul 14 18:00:16 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:16 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Flow 'volume_create_manager' (81e78b40-fbc4-486d-8664-7af470cdc136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cd2f2d-31e3-45b2-8366-07e43e748420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4" returned: 0 in 0.428s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:16 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4 is being set with open permissions: ugo+rw
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cd2f2d-31e3-45b2-8366-07e43e748420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1983393139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4daeba-4966-4232-808c-7cbe03b81f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9d2a16ee43455cbf06494e0d0f5499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:17Z,use_quota=True,user_id='400b56cdd58b4b08af909723bb15b086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:16 devstack sudo[100135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4
Jul 14 18:00:16 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:16 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a50ad5a-cfa7-4cc9-be9f-3b631d57c5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a50ad5a-cfa7-4cc9-be9f-3b631d57c5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5a449f-0aa1-46fd-ac4b-06a23d6eb679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5a449f-0aa1-46fd-ac4b-06a23d6eb679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc4daeba-4966-4232-808c-7cbe03b81f9f', 'volume_name': 'volume-fc4daeba-4966-4232-808c-7cbe03b81f9f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8060aa-3dc4-42d3-83c8-50e19ead1849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8060aa-3dc4-42d3-83c8-50e19ead1849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95d1fa3-62cb-4a27-a725-56d83bf5b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:16 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume fc4daeba-4966-4232-808c-7cbe03b81f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc4daeba-4966-4232-808c-7cbe03b81f9f', 'volume_size': 1}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" returned: 0 in 0.363s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c" released by "delete_volume" :: held 0.910s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Created reservations ['ce6c24fc-53cd-4138-8b45-21e4da0a91f9', '1aeaa5de-a99f-402b-9684-a942d29ef08b', '318d331a-55f7-42c4-b2f8-7363b98c3279', '79a2b0f4-eee6-4142-9d7a-07e79b7d8476'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:16 devstack sudo[100138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:16 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:16 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4" returned: 0 in 0.348s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:17 devstack sudo[100140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.info
Jul 14 18:00:17 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Flow 'volume_create_manager' (cf03f958-2948-4920-8df4-cf42d3dc59a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310a3c7b-f50c-49c2-b9f8-3c02f0539bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310a3c7b-f50c-49c2-b9f8-3c02f0539bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-448485949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba7bbaf-256c-4558-be30-e8c556e36ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9d2a16ee43455cbf06494e0d0f5499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:17Z,use_quota=True,user_id='400b56cdd58b4b08af909723bb15b086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8264ef2e-2007-458b-b07c-d86795f6c34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8264ef2e-2007-458b-b07c-d86795f6c34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8021007-fbc0-434e-8a70-e2731d300ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8021007-fbc0-434e-8a70-e2731d300ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cba7bbaf-256c-4558-be30-e8c556e36ccd', 'volume_name': 'volume-cba7bbaf-256c-4558-be30-e8c556e36ccd', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7051cc9-4064-4e2e-a994-75d282ef4f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7051cc9-4064-4e2e-a994-75d282ef4f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e84d0a-3196-4a36-8f93-30eb7497fafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume cba7bbaf-256c-4558-be30-e8c556e36ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cba7bbaf-256c-4558-be30-e8c556e36ccd', 'volume_size': 1}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:17 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.info" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:17 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.info is being set with open permissions: ugo+rw
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:17 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.459s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:17 devstack sudo[100144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.info
Jul 14 18:00:17 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:17 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Deleted volume successfully.
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1cd22263-edb0-4de7-b5d2-dd4beb8a046a tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-ae75cd38-b6af-4e3d-b7ae-f1ba3429d70c-delete_volume" released by "delete_volume" :: held 3.490s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-691c9bc6-0928-4e20-b3d4-f47423fbdd44-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-691c9bc6-0928-4e20-b3d4-f47423fbdd44-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "cinder-quobyte-691c9bc6-0928-4e20-b3d4-f47423fbdd44" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-691c9bc6-0928-4e20-b3d4-f47423fbdd44" acquired by "delete_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0865e2b6-79fe-4db7-85a8-02f95ad2af16]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:17 devstack sudo[100146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44
Jul 14 18:00:17 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:17 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.info" returned: 0 in 0.495s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.706s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1983393139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4daeba-4966-4232-808c-7cbe03b81f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9d2a16ee43455cbf06494e0d0f5499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:17Z,use_quota=True,user_id='400b56cdd58b4b08af909723bb15b086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Creating volume fc4daeba-4966-4232-808c-7cbe03b81f9f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:17 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fc4daeba-4966-4232-808c-7cbe03b81f9f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:17 devstack sudo[100149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fc4daeba-4966-4232-808c-7cbe03b81f9f 1073741824
Jul 14 18:00:17 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:17 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fb37780b-5ac5-4378-9324-7740562f7cf3 tempest-VolumeDependencyTests-366073106 None] Create snapshot completed successfully
Jul 14 18:00:17 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Flow 'volume_create_manager' (f82ec269-344a-46a1-9e41-e715d3f25dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa6dad0-ef29-45af-bdaa-d20af56c6892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa6dad0-ef29-45af-bdaa-d20af56c6892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-681509196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92251610-1f0e-4330-8592-01ecd42b684a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9d2a16ee43455cbf06494e0d0f5499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:18Z,use_quota=True,user_id='400b56cdd58b4b08af909723bb15b086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ad030b-5b44-4b1f-988d-f985e422f57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ad030b-5b44-4b1f-988d-f985e422f57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495302dd-df77-41d4-b386-982fca8d8463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495302dd-df77-41d4-b386-982fca8d8463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92251610-1f0e-4330-8592-01ecd42b684a', 'volume_name': 'volume-92251610-1f0e-4330-8592-01ecd42b684a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d877e3-e303-4639-888e-3dad57c5f735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d877e3-e303-4639-888e-3dad57c5f735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4973f73b-9554-4f7c-987b-f2712e8c6854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume 92251610-1f0e-4330-8592-01ecd42b684a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92251610-1f0e-4330-8592-01ecd42b684a', 'volume_size': 1}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:18 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44" returned: 0 in 0.522s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:18 devstack sudo[100154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44
Jul 14 18:00:18 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Flow 'volume_create_manager' (f9df2881-3eed-43ba-b204-6f160ecd8816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347ed388-b38e-41c7-a83f-5c3773d36b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347ed388-b38e-41c7-a83f-5c3773d36b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-382433758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4362fb34-67de-4304-9518-e16ba304cafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9d2a16ee43455cbf06494e0d0f5499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:18Z,use_quota=True,user_id='400b56cdd58b4b08af909723bb15b086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badc2d49-2250-4353-a9c9-5d088c35b81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:18 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badc2d49-2250-4353-a9c9-5d088c35b81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff5cde8-bb48-4f82-8947-326a263ba989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff5cde8-bb48-4f82-8947-326a263ba989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4362fb34-67de-4304-9518-e16ba304cafa', 'volume_name': 'volume-4362fb34-67de-4304-9518-e16ba304cafa', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c49606-7cd8-43bf-bc78-548450dac06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c49606-7cd8-43bf-bc78-548450dac06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901e8818-43bb-4207-aeb2-f72fbe99ff6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:18 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume 4362fb34-67de-4304-9518-e16ba304cafa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4362fb34-67de-4304-9518-e16ba304cafa', 'volume_size': 1}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-691c9bc6-0928-4e20-b3d4-f47423fbdd44" returned: 0 in 0.438s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fc4daeba-4966-4232-808c-7cbe03b81f9f 1073741824" returned: 0 in 0.757s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-quobyte-691c9bc6-0928-4e20-b3d4-f47423fbdd44" released by "delete_volume" :: held 1.034s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fc4daeba-4966-4232-808c-7cbe03b81f9f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:18 devstack sudo[100161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fc4daeba-4966-4232-808c-7cbe03b81f9f
Jul 14 18:00:18 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Created reservations ['677704b5-e14f-4268-8df6-f0140aa81ab1', 'b97eba8d-00e9-4a5c-8b3e-6f92776ef583', '4e21a55c-e167-451b-b55d-fbb4323847ef', 'aeae1047-0df4-4f11-b381-a86332e70494'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:18 devstack sudo[100163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:18 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Flow 'volume_create_manager' (6bd539c5-e65d-4a9c-8ff0-7c7086bfb878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86adba17-8c3c-4fd7-84ae-ce9904fb2bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86adba17-8c3c-4fd7-84ae-ce9904fb2bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1764393795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1623d6-c48a-4c58-ac8b-5667716913c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9d2a16ee43455cbf06494e0d0f5499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:19Z,use_quota=True,user_id='400b56cdd58b4b08af909723bb15b086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ff78ca-70fc-4cb8-aa18-7b4c76553d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ff78ca-70fc-4cb8-aa18-7b4c76553d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064e5afc-6b90-43d1-be34-90fdefa3613a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064e5afc-6b90-43d1-be34-90fdefa3613a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c1623d6-c48a-4c58-ac8b-5667716913c8', 'volume_name': 'volume-2c1623d6-c48a-4c58-ac8b-5667716913c8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a62038-6051-4810-be0b-7cae34aa3f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a62038-6051-4810-be0b-7cae34aa3f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801c77c9-e1c1-42ba-b672-2576101440e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume 2c1623d6-c48a-4c58-ac8b-5667716913c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c1623d6-c48a-4c58-ac8b-5667716913c8', 'volume_size': 1}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:19 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fc4daeba-4966-4232-808c-7cbe03b81f9f" returned: 0 in 0.490s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.886s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-448485949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba7bbaf-256c-4558-be30-e8c556e36ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9d2a16ee43455cbf06494e0d0f5499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:17Z,use_quota=True,user_id='400b56cdd58b4b08af909723bb15b086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Creating volume cba7bbaf-256c-4558-be30-e8c556e36ccd {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:19 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cba7bbaf-256c-4558-be30-e8c556e36ccd 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:19 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.378s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:19 devstack sudo[100167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cba7bbaf-256c-4558-be30-e8c556e36ccd 1073741824
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95d1fa3-62cb-4a27-a725-56d83bf5b292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4daeba-4966-4232-808c-7cbe03b81f9f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:19 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8645b74-0c40-4e02-9536-108390d05ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Deleted volume successfully.
Jul 14 18:00:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume volume-fc4daeba-4966-4232-808c-7cbe03b81f9f (fc4daeba-4966-4232-808c-7cbe03b81f9f): created successfully
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8645b74-0c40-4e02-9536-108390d05ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Flow 'volume_create_manager' (81e78b40-fbc4-486d-8664-7af470cdc136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7d877e59-6a02-47f0-9edc-65e5d9e7802d tempest-VolumesDeleteCascade-824967910 None] Lock "cinder-691c9bc6-0928-4e20-b3d4-f47423fbdd44-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f06a8a08-fb40-495a-b235-b5ff675a7d62 tempest-CreateVolumesFromSnapshotTest-263665741 None] Created volume successfully.
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Flow 'volume_create_manager' (00847230-2bec-46ce-9ad2-3d7a435ea5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e8015b-7dbb-4b1f-9451-4285cf74422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e8015b-7dbb-4b1f-9451-4285cf74422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1690975895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97516413-da3b-41be-b63a-02f6110a9202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9820935477f14883a06bcf3b7334bdb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=33ee2d33-281c-4164-8920-783933df1df4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:19Z,use_quota=True,user_id='7ed958d2d7e743798ed28518fba37a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c246c055-2cf4-4941-b0b2-124caab2d60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c246c055-2cf4-4941-b0b2-124caab2d60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d57bcb9-4bd8-4b35-aef5-971d2f0b9d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d57bcb9-4bd8-4b35-aef5-971d2f0b9d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '97516413-da3b-41be-b63a-02f6110a9202', 'volume_name': 'volume-97516413-da3b-41be-b63a-02f6110a9202', 'volume_size': 1, 'snapshot_id': '33ee2d33-281c-4164-8920-783933df1df4'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94563a3c-f7e7-4f2b-b654-5a312d47fb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94563a3c-f7e7-4f2b-b654-5a312d47fb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b646bc91-4b1f-450c-aaf2-ea0f29579169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Volume 97516413-da3b-41be-b63a-02f6110a9202: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-97516413-da3b-41be-b63a-02f6110a9202', 'volume_size': 1, 'snapshot_id': '33ee2d33-281c-4164-8920-783933df1df4'}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:19 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cba7bbaf-256c-4558-be30-e8c556e36ccd 1073741824" returned: 0 in 0.526s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cba7bbaf-256c-4558-be30-e8c556e36ccd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:19 devstack sudo[100174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cba7bbaf-256c-4558-be30-e8c556e36ccd
Jul 14 18:00:19 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:20 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cba7bbaf-256c-4558-be30-e8c556e36ccd" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.977s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-681509196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92251610-1f0e-4330-8592-01ecd42b684a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9d2a16ee43455cbf06494e0d0f5499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:18Z,use_quota=True,user_id='400b56cdd58b4b08af909723bb15b086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Creating volume 92251610-1f0e-4330-8592-01ecd42b684a {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:20 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-92251610-1f0e-4330-8592-01ecd42b684a 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e84d0a-3196-4a36-8f93-30eb7497fafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cba7bbaf-256c-4558-be30-e8c556e36ccd', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573af069-5ab4-4bd5-8ca9-8a25b28a6df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:20 devstack sudo[100177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-92251610-1f0e-4330-8592-01ecd42b684a 1073741824
Jul 14 18:00:20 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:20 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume volume-cba7bbaf-256c-4558-be30-e8c556e36ccd (cba7bbaf-256c-4558-be30-e8c556e36ccd): created successfully
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573af069-5ab4-4bd5-8ca9-8a25b28a6df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Flow 'volume_create_manager' (cf03f958-2948-4920-8df4-cf42d3dc59a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-33e139be-7b39-4de6-bdaa-00f694565838 tempest-CreateVolumesFromSnapshotTest-263665741 None] Created volume successfully.
Jul 14 18:00:20 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-92251610-1f0e-4330-8592-01ecd42b684a 1073741824" returned: 0 in 0.487s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-92251610-1f0e-4330-8592-01ecd42b684a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:20 devstack sudo[100183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-92251610-1f0e-4330-8592-01ecd42b684a
Jul 14 18:00:20 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:20 devstack sudo[100185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:20 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:20 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-92251610-1f0e-4330-8592-01ecd42b684a" returned: 0 in 0.308s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.341s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-382433758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4362fb34-67de-4304-9518-e16ba304cafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9d2a16ee43455cbf06494e0d0f5499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:18Z,use_quota=True,user_id='400b56cdd58b4b08af909723bb15b086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Creating volume 4362fb34-67de-4304-9518-e16ba304cafa {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:20 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4362fb34-67de-4304-9518-e16ba304cafa 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:21 devstack sudo[100188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4362fb34-67de-4304-9518-e16ba304cafa 1073741824
Jul 14 18:00:21 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4973f73b-9554-4f7c-987b-f2712e8c6854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92251610-1f0e-4330-8592-01ecd42b684a', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126d358f-87da-4ab1-a0df-8749429e9dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume volume-92251610-1f0e-4330-8592-01ecd42b684a (92251610-1f0e-4330-8592-01ecd42b684a): created successfully
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126d358f-87da-4ab1-a0df-8749429e9dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Flow 'volume_create_manager' (f82ec269-344a-46a1-9e41-e715d3f25dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-533a7d08-2e5e-4419-921b-45d1b93b055e tempest-CreateVolumesFromSnapshotTest-263665741 None] Created volume successfully.
Jul 14 18:00:21 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.402s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Flow 'volume_create_manager' (0d9dc92f-566c-4162-aced-8d020b245cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cdcf13-7059-4d36-9f1c-2751191501d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cdcf13-7059-4d36-9f1c-2751191501d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1789104031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cc0f50-f80d-418e-ad12-d8494009200c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a41ad8e42ce4a59b007cbddd2870f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:21Z,use_quota=True,user_id='22229079be4d41bca05a66c2e48484de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ae75cc-9181-4319-bdbe-0d1713dc4186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ae75cc-9181-4319-bdbe-0d1713dc4186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcf2f96-341f-4297-b23b-c12af19d491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcf2f96-341f-4297-b23b-c12af19d491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93cc0f50-f80d-418e-ad12-d8494009200c', 'volume_name': 'volume-93cc0f50-f80d-418e-ad12-d8494009200c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f66355-0c6a-4fd7-97b5-1541456f9b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:21 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f66355-0c6a-4fd7-97b5-1541456f9b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321a379a-e0f1-4848-9166-597b06ea2d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Volume 93cc0f50-f80d-418e-ad12-d8494009200c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93cc0f50-f80d-418e-ad12-d8494009200c', 'volume_size': 1}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4362fb34-67de-4304-9518-e16ba304cafa 1073741824" returned: 0 in 0.624s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4362fb34-67de-4304-9518-e16ba304cafa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:21 devstack sudo[100195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4362fb34-67de-4304-9518-e16ba304cafa
Jul 14 18:00:21 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:21 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4362fb34-67de-4304-9518-e16ba304cafa" returned: 0 in 0.239s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.797s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1764393795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c1623d6-c48a-4c58-ac8b-5667716913c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9d2a16ee43455cbf06494e0d0f5499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:19Z,use_quota=True,user_id='400b56cdd58b4b08af909723bb15b086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Creating volume 2c1623d6-c48a-4c58-ac8b-5667716913c8 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:21 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2c1623d6-c48a-4c58-ac8b-5667716913c8 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901e8818-43bb-4207-aeb2-f72fbe99ff6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4362fb34-67de-4304-9518-e16ba304cafa', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:21 devstack sudo[100198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2c1623d6-c48a-4c58-ac8b-5667716913c8 1073741824
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b782f594-e49a-4af9-87b9-5b9eb6d8e552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:21 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume volume-4362fb34-67de-4304-9518-e16ba304cafa (4362fb34-67de-4304-9518-e16ba304cafa): created successfully
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b782f594-e49a-4af9-87b9-5b9eb6d8e552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Flow 'volume_create_manager' (f9df2881-3eed-43ba-b204-6f160ecd8816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a972a873-242c-4d8d-a0e4-3d350caa569b tempest-CreateVolumesFromSnapshotTest-263665741 None] Created volume successfully.
Jul 14 18:00:22 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2c1623d6-c48a-4c58-ac8b-5667716913c8 1073741824" returned: 0 in 0.462s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2c1623d6-c48a-4c58-ac8b-5667716913c8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:22 devstack sudo[100204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2c1623d6-c48a-4c58-ac8b-5667716913c8
Jul 14 18:00:22 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:22 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2c1623d6-c48a-4c58-ac8b-5667716913c8" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.154s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "cinder-quobyte-33ee2d33-281c-4164-8920-783933df1df4-97516413-da3b-41be-b63a-02f6110a9202" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801c77c9-e1c1-42ba-b672-2576101440e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c1623d6-c48a-4c58-ac8b-5667716913c8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de75a33-e438-4251-b257-737c79d75375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-quobyte-33ee2d33-281c-4164-8920-783933df1df4-97516413-da3b-41be-b63a-02f6110a9202" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Creating volume 97516413-da3b-41be-b63a-02f6110a9202 from snapshot 33ee2d33-281c-4164-8920-783933df1df4 {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "cinder-quobyte-97516413-da3b-41be-b63a-02f6110a9202" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Volume volume-2c1623d6-c48a-4c58-ac8b-5667716913c8 (2c1623d6-c48a-4c58-ac8b-5667716913c8): created successfully
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de75a33-e438-4251-b257-737c79d75375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Flow 'volume_create_manager' (6bd539c5-e65d-4a9c-8ff0-7c7086bfb878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-quobyte-97516413-da3b-41be-b63a-02f6110a9202" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] snapshot: 33ee2d33-281c-4164-8920-783933df1df4, volume: 97516413-da3b-41be-b63a-02f6110a9202,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 18:00:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-870a30b2-b89a-4d03-9e89-f1715544dd01 tempest-CreateVolumesFromSnapshotTest-263665741 None] Created volume successfully.
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c797a9-a79f-4865-8700-4c8019f35fcf]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:22 devstack sudo[100207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4
Jul 14 18:00:22 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:23 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4" returned: 0 in 0.365s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15db1e4-ffdf-4a35-80f5-0d0e8aa32139]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:23 devstack sudo[100213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c
Jul 14 18:00:23 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-2c1623d6-c48a-4c58-ac8b-5667716913c8-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-2c1623d6-c48a-4c58-ac8b-5667716913c8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-quobyte-2c1623d6-c48a-4c58-ac8b-5667716913c8" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-2c1623d6-c48a-4c58-ac8b-5667716913c8" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e6c18e-9306-423c-b731-b904a31a1ba0]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2c1623d6-c48a-4c58-ac8b-5667716913c8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:23 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" returned: 0 in 0.452s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Path /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:23 devstack sudo[100215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2c1623d6-c48a-4c58-ac8b-5667716913c8
Jul 14 18:00:23 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:23 devstack sudo[100219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202
Jul 14 18:00:23 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:23 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2c1623d6-c48a-4c58-ac8b-5667716913c8" returned: 0 in 0.416s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2c1623d6-c48a-4c58-ac8b-5667716913c8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:23 devstack sudo[100228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2c1623d6-c48a-4c58-ac8b-5667716913c8
Jul 14 18:00:23 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:24 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2c1623d6-c48a-4c58-ac8b-5667716913c8" returned: 0 in 0.501s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-2c1623d6-c48a-4c58-ac8b-5667716913c8" released by "delete_volume" :: held 0.992s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:24 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Created reservations ['35577516-4f6d-4d0f-929b-dfe783bfe1e1', '42383e6e-8ff0-4db4-a2bf-7cd7fd68eec2', '63fb3cf3-01e8-44ca-83aa-83d5bd77de95', '430bd0a8-2813-45d4-98d2-a929a9989fd3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:24 devstack sudo[100238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:24 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-4362fb34-67de-4304-9518-e16ba304cafa-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-4362fb34-67de-4304-9518-e16ba304cafa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:25 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.470s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:25 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-quobyte-4362fb34-67de-4304-9518-e16ba304cafa" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Deleted volume successfully.
Jul 14 18:00:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-752d8b0e-41ac-4cfe-af22-d0eac1d9bf1d tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-2c1623d6-c48a-4c58-ac8b-5667716913c8-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-4362fb34-67de-4304-9518-e16ba304cafa" acquired by "delete_volume" :: waited 0.056s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4881384d-b458-4ceb-b6b6-c209087ee96f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4362fb34-67de-4304-9518-e16ba304cafa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:25 devstack sudo[100243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4362fb34-67de-4304-9518-e16ba304cafa
Jul 14 18:00:25 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Flow 'volume_create_manager' (12915c8b-4d9b-46a3-852d-3c6d159b8210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b40f74-70e8-43cd-9fef-41d544f2689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b40f74-70e8-43cd-9fef-41d544f2689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-763168775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9eafab-462b-44e4-840c-4484df287b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0f7d944de54dddb42241196f843495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:26Z,use_quota=True,user_id='db93683959ae436cb78a73e538f3da99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d735f9-e69c-4570-802a-2325c2379f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d735f9-e69c-4570-802a-2325c2379f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b92ce1-5651-4f36-ab1d-2c404478769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b92ce1-5651-4f36-ab1d-2c404478769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9eafab-462b-44e4-840c-4484df287b34', 'volume_name': 'volume-cd9eafab-462b-44e4-840c-4484df287b34', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edde6597-89d6-448e-be13-45e8740c4545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edde6597-89d6-448e-be13-45e8740c4545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c816413-de5e-4af2-8040-39e738d6b341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Volume cd9eafab-462b-44e4-840c-4484df287b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9eafab-462b-44e4-840c-4484df287b34', 'volume_size': 1}
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:26 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4362fb34-67de-4304-9518-e16ba304cafa" returned: 0 in 0.914s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4362fb34-67de-4304-9518-e16ba304cafa {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:26 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4362fb34-67de-4304-9518-e16ba304cafa
Jul 14 18:00:26 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:27 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4362fb34-67de-4304-9518-e16ba304cafa" returned: 0 in 0.661s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-4362fb34-67de-4304-9518-e16ba304cafa" released by "delete_volume" :: held 1.694s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Created reservations ['011c2569-3f6a-420f-9660-16cb63a00568', 'd981179c-74b0-45c2-8276-9367b9a272b7', '1bb2ba8f-84f8-44e1-828c-b47af84509f4', 'c6eb461b-2261-4725-a071-f3d96b704d6a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:27 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:27 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-92251610-1f0e-4330-8592-01ecd42b684a-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-92251610-1f0e-4330-8592-01ecd42b684a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-quobyte-92251610-1f0e-4330-8592-01ecd42b684a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-92251610-1f0e-4330-8592-01ecd42b684a" acquired by "delete_volume" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[934520f1-bdd3-492e-901e-9b250b5f7117]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-92251610-1f0e-4330-8592-01ecd42b684a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:28 devstack sudo[100253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-92251610-1f0e-4330-8592-01ecd42b684a
Jul 14 18:00:28 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:28 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.710s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:28 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Deleted volume successfully.
Jul 14 18:00:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-4031648d-99ae-482d-a3fc-8b3a2ee0c9e1 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-4362fb34-67de-4304-9518-e16ba304cafa-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:28 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-92251610-1f0e-4330-8592-01ecd42b684a" returned: 0 in 0.841s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-92251610-1f0e-4330-8592-01ecd42b684a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:28 devstack sudo[100261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-92251610-1f0e-4330-8592-01ecd42b684a
Jul 14 18:00:28 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:28 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202" returned: 0 in 5.288s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:28 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8662f031-0ab8-4cf4-b1ec-ae082553b8f1]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:29 devstack sudo[100263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c
Jul 14 18:00:29 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:29 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-92251610-1f0e-4330-8592-01ecd42b684a" returned: 0 in 0.286s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-92251610-1f0e-4330-8592-01ecd42b684a" released by "delete_volume" :: held 1.215s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Created reservations ['b85b144c-d87f-457d-bf08-200c6e50099c', 'b20278a3-7bf1-4e58-af0d-9cd0f4b17a52', '304104c4-0929-4415-a19f-dc33f1153027', '363b6f99-411f-481d-b734-61da3192f813'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:29 devstack sudo[100266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:29 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:29 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" returned: 0 in 0.543s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:00:29 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Converted 1024.00 MB image at 193.62 MB/s
Jul 14 18:00:29 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202 is being set with open permissions: ugo+rw
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:29 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Deleted volume successfully.
Jul 14 18:00:29 devstack sudo[100273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202
Jul 14 18:00:29 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d05b6dc7-9742-4869-8651-8456a8db986f tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-92251610-1f0e-4330-8592-01ecd42b684a-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:29 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202" returned: 0 in 0.255s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-quobyte-97516413-da3b-41be-b63a-02f6110a9202" released by "_copy_volume_from_snapshot" :: held 7.007s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-quobyte-33ee2d33-281c-4164-8920-783933df1df4-97516413-da3b-41be-b63a-02f6110a9202" released by "_create_volume_from_snapshot" :: held 7.057s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.089s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.135s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1789104031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cc0f50-f80d-418e-ad12-d8494009200c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a41ad8e42ce4a59b007cbddd2870f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:21Z,use_quota=True,user_id='22229079be4d41bca05a66c2e48484de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Creating volume 93cc0f50-f80d-418e-ad12-d8494009200c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:29 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-93cc0f50-f80d-418e-ad12-d8494009200c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:29 devstack sudo[100276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-93cc0f50-f80d-418e-ad12-d8494009200c 1073741824
Jul 14 18:00:29 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b646bc91-4b1f-450c-aaf2-ea0f29579169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97516413-da3b-41be-b63a-02f6110a9202', 'volume_size': 1, 'snapshot_id': '33ee2d33-281c-4164-8920-783933df1df4'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d970d85-1dd4-44ad-a78c-16e59713b4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:29 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Volume volume-97516413-da3b-41be-b63a-02f6110a9202 (97516413-da3b-41be-b63a-02f6110a9202): created successfully
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d970d85-1dd4-44ad-a78c-16e59713b4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Flow 'volume_create_manager' (00847230-2bec-46ce-9ad2-3d7a435ea5ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7f8f9d3a-88b5-4861-bc1c-b25af7083578 tempest-VolumeDependencyTests-366073106 None] Created volume successfully.
Jul 14 18:00:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-cba7bbaf-256c-4558-be30-e8c556e36ccd-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-cba7bbaf-256c-4558-be30-e8c556e36ccd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-quobyte-cba7bbaf-256c-4558-be30-e8c556e36ccd" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-cba7bbaf-256c-4558-be30-e8c556e36ccd" acquired by "delete_volume" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fa3527-24fd-48be-ab02-bc9071dd218d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cba7bbaf-256c-4558-be30-e8c556e36ccd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:30 devstack sudo[100281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cba7bbaf-256c-4558-be30-e8c556e36ccd
Jul 14 18:00:30 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:30 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-93cc0f50-f80d-418e-ad12-d8494009200c 1073741824" returned: 0 in 0.461s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-93cc0f50-f80d-418e-ad12-d8494009200c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:30 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-93cc0f50-f80d-418e-ad12-d8494009200c
Jul 14 18:00:30 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:30 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cba7bbaf-256c-4558-be30-e8c556e36ccd" returned: 0 in 0.378s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cba7bbaf-256c-4558-be30-e8c556e36ccd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:30 devstack sudo[100288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cba7bbaf-256c-4558-be30-e8c556e36ccd
Jul 14 18:00:30 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:30 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-93cc0f50-f80d-418e-ad12-d8494009200c" returned: 0 in 0.258s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.267s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-763168775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9eafab-462b-44e4-840c-4484df287b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0f7d944de54dddb42241196f843495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:26Z,use_quota=True,user_id='db93683959ae436cb78a73e538f3da99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Creating volume cd9eafab-462b-44e4-840c-4484df287b34 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:30 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cd9eafab-462b-44e4-840c-4484df287b34 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:30 devstack sudo[100291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cd9eafab-462b-44e4-840c-4484df287b34 1073741824
Jul 14 18:00:30 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321a379a-e0f1-4848-9166-597b06ea2d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93cc0f50-f80d-418e-ad12-d8494009200c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd80fb23-e591-43c0-b8e0-37ec6c12b363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:30 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Volume volume-93cc0f50-f80d-418e-ad12-d8494009200c (93cc0f50-f80d-418e-ad12-d8494009200c): created successfully
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd80fb23-e591-43c0-b8e0-37ec6c12b363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Flow 'volume_create_manager' (0d9dc92f-566c-4162-aced-8d020b245cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7c921a24-7958-4feb-b5a3-6308c25337ee tempest-AbsoluteLimitsTests-1483467334 None] Created volume successfully.
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "cinder-33ee2d33-281c-4164-8920-783933df1df4-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-33ee2d33-281c-4164-8920-783933df1df4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "cinder-quobyte-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-quobyte-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "cinder-quobyte-33ee2d33-281c-4164-8920-783933df1df4" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-quobyte-33ee2d33-281c-4164-8920-783933df1df4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Deleting offline snapshot 33ee2d33-281c-4164-8920-783933df1df4 of volume 3b7da920-c8a8-4988-a688-7dfda4d2ab0c {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:00:30 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] snapshot_file for this snap is: volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cba7bbaf-256c-4558-be30-e8c556e36ccd" returned: 0 in 0.299s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[32742148-73ec-4237-952f-c10d89b0a9e7]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-cba7bbaf-256c-4558-be30-e8c556e36ccd" released by "delete_volume" :: held 0.727s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Created reservations ['5d44299c-8e31-49de-a869-75f196fb8bed', '8b7b492c-ccb4-4911-9419-531f684126ac', '98fe7888-966b-41f4-80c9-29f9175202a8', 'd0e5b94b-ea75-4a92-bb76-d672e904b32f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:30 devstack sudo[100294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4
Jul 14 18:00:30 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:30 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:30 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:31 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cd9eafab-462b-44e4-840c-4484df287b34 1073741824" returned: 0 in 0.510s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cd9eafab-462b-44e4-840c-4484df287b34 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:31 devstack sudo[100303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cd9eafab-462b-44e4-840c-4484df287b34
Jul 14 18:00:31 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:31 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4" returned: 0 in 0.391s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:00:31 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-fc4daeba-4966-4232-808c-7cbe03b81f9f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9536204-3986-4ba8-b0d9-4540eae9cf3c]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Deleted volume successfully.
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-fc4daeba-4966-4232-808c-7cbe03b81f9f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f61458bb-b4f5-448c-b6cf-eb99ccd48364 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-cba7bbaf-256c-4558-be30-e8c556e36ccd-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-quobyte-fc4daeba-4966-4232-808c-7cbe03b81f9f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-fc4daeba-4966-4232-808c-7cbe03b81f9f" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae30915-555d-408f-9e94-89fa4251b66b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fc4daeba-4966-4232-808c-7cbe03b81f9f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:31 devstack sudo[100307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c
Jul 14 18:00:31 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:31 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cd9eafab-462b-44e4-840c-4484df287b34" returned: 0 in 0.294s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c816413-de5e-4af2-8040-39e738d6b341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9eafab-462b-44e4-840c-4484df287b34', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05e86a0-091f-4794-b448-01f0c5a18c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:31 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Volume volume-cd9eafab-462b-44e4-840c-4484df287b34 (cd9eafab-462b-44e4-840c-4484df287b34): created successfully
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05e86a0-091f-4794-b448-01f0c5a18c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Flow 'volume_create_manager' (12915c8b-4d9b-46a3-852d-3c6d159b8210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d41601c2-412f-4640-9084-2d217b49ab44 tempest-VolumesTransfersV357Test-35320915 None] Created volume successfully.
Jul 14 18:00:31 devstack sudo[100309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fc4daeba-4966-4232-808c-7cbe03b81f9f
Jul 14 18:00:31 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:31 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" returned: 0 in 0.402s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:31 devstack sudo[100315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4
Jul 14 18:00:31 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:31 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fc4daeba-4966-4232-808c-7cbe03b81f9f" returned: 0 in 0.394s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fc4daeba-4966-4232-808c-7cbe03b81f9f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:31 devstack sudo[100320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fc4daeba-4966-4232-808c-7cbe03b81f9f
Jul 14 18:00:31 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Acquiring lock "cinder-93cc0f50-f80d-418e-ad12-d8494009200c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Lock "cinder-93cc0f50-f80d-418e-ad12-d8494009200c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Acquiring lock "cinder-quobyte-93cc0f50-f80d-418e-ad12-d8494009200c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:31 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4" returned: 0 in 0.386s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Lock "cinder-quobyte-93cc0f50-f80d-418e-ad12-d8494009200c" acquired by "delete_volume" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:32 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:32 devstack sudo[100326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4
Jul 14 18:00:32 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fc4daeba-4966-4232-808c-7cbe03b81f9f" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-fc4daeba-4966-4232-808c-7cbe03b81f9f" released by "delete_volume" :: held 0.740s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d011c16d-5e11-481c-9e8f-8f678547f656]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-93cc0f50-f80d-418e-ad12-d8494009200c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Created reservations ['fa654014-2c21-44ce-a0fc-9c083d950e48', '41801a42-8c0e-4aca-bc5c-37afc49ff8ca', '706871d0-db20-42ea-8486-96d5c96b5a36', '09cbe3da-5b21-4ca4-946a-015f1462ba5c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:32 devstack sudo[100328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-93cc0f50-f80d-418e-ad12-d8494009200c
Jul 14 18:00:32 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:32 devstack sudo[100330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:32 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:32 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c.33ee2d33-281c-4164-8920-783933df1df4" returned: 0 in 0.291s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-quobyte-33ee2d33-281c-4164-8920-783933df1df4" released by "_delete_snapshot" :: held 1.611s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-quobyte-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" released by "delete_snapshot" :: held 1.645s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-97abca17-0b47-494a-91cb-83f9103d43b6-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-97abca17-0b47-494a-91cb-83f9103d43b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-quobyte-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-quobyte-97abca17-0b47-494a-91cb-83f9103d43b6" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:32 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:32 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-97abca17-0b47-494a-91cb-83f9103d43b6" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Deleting offline snapshot 97abca17-0b47-494a-91cb-83f9103d43b6 of volume beb9fe1b-bfa8-4e1c-a68d-34f3f757640d {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] snapshot_file for this snap is: volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:00:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Deleted volume successfully.
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Created reservations ['3017d49d-14c7-4527-afcf-cf620a2d48a0', '8711ed9a-c955-4710-ad9f-2282a6ffb86c', '09002944-aea4-45b0-92e2-74750ed6b810', 'a08d15f7-0901-4c10-93e0-0da063643b2c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9039a0-2f31-49f9-ab1d-062a9ecb8a38]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-93cc0f50-f80d-418e-ad12-d8494009200c" returned: 0 in 0.470s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-93cc0f50-f80d-418e-ad12-d8494009200c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:32 devstack sudo[100338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-93cc0f50-f80d-418e-ad12-d8494009200c
Jul 14 18:00:32 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76f19c09-0079-4bd9-99b5-e00ee7fe5dc7 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-fc4daeba-4966-4232-808c-7cbe03b81f9f-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Delete snapshot completed successfully.
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fbc83449-b2ed-4904-a856-26c6e5d6d5a5 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-33ee2d33-281c-4164-8920-783933df1df4-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:32 devstack sudo[100337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6
Jul 14 18:00:32 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:32 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-93cc0f50-f80d-418e-ad12-d8494009200c" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "cinder-3b7da920-c8a8-4988-a688-7dfda4d2ab0c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Lock "cinder-quobyte-93cc0f50-f80d-418e-ad12-d8494009200c" released by "delete_volume" :: held 0.895s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-3b7da920-c8a8-4988-a688-7dfda4d2ab0c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:32 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6" returned: 0 in 0.442s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9313f13-1d99-467e-8185-a84d3e536db8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "cinder-quobyte-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-quobyte-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" acquired by "delete_volume" :: waited 0.044s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Created reservations ['c3cd3f48-4ca1-4c9b-ad4a-ee9a059e8bab', '784f21b3-57ab-4c64-942f-7b6382778198', '01a91a8d-d16c-418a-93d7-8a247dfb3fa7', '7c74871c-0140-4002-9436-4b58a2c73cdb'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7711a94-4540-422e-a1d0-b7e14c5df222]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:33 devstack sudo[100345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d
Jul 14 18:00:33 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:33 devstack sudo[100348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:33 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:33 devstack sudo[100346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c
Jul 14 18:00:33 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-15278d73-3740-4ed3-b387-1d0a4928eaa1 tempest-VolumesTransfersV357Test-1897214754 None] Transfer volume completed successfully.
Jul 14 18:00:33 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d" returned: 0 in 0.476s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:33 devstack sudo[100356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6
Jul 14 18:00:33 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:33 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.346s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:33 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" returned: 0 in 0.475s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Deleted volume successfully.
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fb1f2205-deaa-498b-9321-8a904c4e96fc tempest-AbsoluteLimitsTests-1483467334 None] Lock "cinder-93cc0f50-f80d-418e-ad12-d8494009200c-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:33 devstack sudo[100363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c
Jul 14 18:00:33 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Acquiring lock "cinder-cd9eafab-462b-44e4-840c-4484df287b34-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Lock "cinder-cd9eafab-462b-44e4-840c-4484df287b34-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:33 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:33 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6" returned: 0 in 0.402s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:33 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6
Jul 14 18:00:33 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Acquiring lock "cinder-quobyte-cd9eafab-462b-44e4-840c-4484df287b34" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-quobyte-3b7da920-c8a8-4988-a688-7dfda4d2ab0c" released by "delete_volume" :: held 0.866s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Lock "cinder-quobyte-cd9eafab-462b-44e4-840c-4484df287b34" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8532a39b-534b-431e-9d69-3b79c813a55f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cd9eafab-462b-44e4-840c-4484df287b34 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Created reservations ['7cd99380-6468-416f-a19e-2e2160284d0b', 'dd483751-87ea-4ecd-a086-c243ee036ac0', '7e165120-8e92-4013-a3f7-0caddebbb033', 'ab547f4e-5ba2-4f27-be27-50d62223689d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:34 devstack sudo[100372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cd9eafab-462b-44e4-840c-4484df287b34
Jul 14 18:00:34 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:34 devstack sudo[100374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:34 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:34 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d.97abca17-0b47-494a-91cb-83f9103d43b6" returned: 0 in 0.315s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-97abca17-0b47-494a-91cb-83f9103d43b6" released by "_delete_snapshot" :: held 1.778s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d" released by "delete_snapshot" :: held 1.825s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Created reservations ['387ce6d9-033a-4343-81c3-eabe626919bb', '8fc59e69-d0af-4438-98f1-e712ca088052', '0086efe0-0145-452a-bf9e-dae47db1f0e0', '71023432-2c33-4826-8e46-73c82ce207c9'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:34 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cd9eafab-462b-44e4-840c-4484df287b34" returned: 0 in 0.412s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cd9eafab-462b-44e4-840c-4484df287b34 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:34 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:34 devstack sudo[100382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cd9eafab-462b-44e4-840c-4484df287b34
Jul 14 18:00:34 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.299s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Delete snapshot completed successfully.
Jul 14 18:00:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Deleted volume successfully.
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0a2434a7-7e36-4beb-a293-99fae3172666 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-97abca17-0b47-494a-91cb-83f9103d43b6-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8044e5c4-77c5-4967-ad73-e88911b48c79 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-3b7da920-c8a8-4988-a688-7dfda4d2ab0c-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "cinder-quobyte-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:34 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cd9eafab-462b-44e4-840c-4484df287b34" returned: 0 in 0.299s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Lock "cinder-quobyte-cd9eafab-462b-44e4-840c-4484df287b34" released by "delete_volume" :: held 0.754s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c07365-4256-40b9-8a64-575504c4398b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Created reservations ['cab800e8-f0b4-4f28-bc63-870b421da0ea', '1c441389-7df8-4e59-9f2d-72c46c9bc0d4', '2ccd5cf8-8985-4bd1-82ba-46dacdee82b8', '79d61628-4703-47b3-bef1-221b15523306'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:34 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d
Jul 14 18:00:34 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:34 devstack sudo[100387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:34 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:35 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Deleted volume successfully.
Jul 14 18:00:35 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d" returned: 0 in 0.441s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "cinder-97516413-da3b-41be-b63a-02f6110a9202-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:35 devstack sudo[100394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d
Jul 14 18:00:35 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9d876b58-1f0f-4aa6-9f1e-c22439e50c9c tempest-VolumesTransfersV357Test-741145805 None] Lock "cinder-cd9eafab-462b-44e4-840c-4484df287b34-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-97516413-da3b-41be-b63a-02f6110a9202-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "cinder-quobyte-97516413-da3b-41be-b63a-02f6110a9202" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-quobyte-97516413-da3b-41be-b63a-02f6110a9202" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f29f875-7f5c-4025-97b7-4d13185b5e89]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:35 devstack sudo[100396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202
Jul 14 18:00:35 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:35 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d" returned: 0 in 0.373s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-quobyte-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d" released by "delete_volume" :: held 0.895s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Created reservations ['910048fb-1522-4742-bb52-16dce25beed7', 'cb490eec-65bc-4cb4-b576-af4352448093', '1450d9c2-70de-4fab-b439-2feed1bd36a4', '39700414-8817-4d6b-86dc-962a30c9d27c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:35 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202" returned: 0 in 0.458s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:35 devstack sudo[100402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202
Jul 14 18:00:35 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:35 devstack sudo[100404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:35 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Flow 'volume_create_manager' (b5084441-6ad2-48cb-8d04-af62e992dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1088c4-46bc-475f-a23b-5319b4b253d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1088c4-46bc-475f-a23b-5319b4b253d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1630472034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8156b20f-7f57-413d-84c4-37dfe9bb8aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0f7d944de54dddb42241196f843495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:36Z,use_quota=True,user_id='db93683959ae436cb78a73e538f3da99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20b4161-3b57-43f5-bd62-38a31db51aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20b4161-3b57-43f5-bd62-38a31db51aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce3d322-18d8-4f94-9c83-f810f564be48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce3d322-18d8-4f94-9c83-f810f564be48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8156b20f-7f57-413d-84c4-37dfe9bb8aa5', 'volume_name': 'volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671cc7c7-b195-48e5-8989-31f7b1d82395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671cc7c7-b195-48e5-8989-31f7b1d82395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979e7f16-2800-4b37-87a0-e60b1f9bb9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:35 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Volume 8156b20f-7f57-413d-84c4-37dfe9bb8aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5', 'volume_size': 1}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1630472034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8156b20f-7f57-413d-84c4-37dfe9bb8aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0f7d944de54dddb42241196f843495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:36Z,use_quota=True,user_id='db93683959ae436cb78a73e538f3da99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Creating volume 8156b20f-7f57-413d-84c4-37dfe9bb8aa5 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:35 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:36 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5 1073741824
Jul 14 18:00:36 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:36 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.302s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:36 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-97516413-da3b-41be-b63a-02f6110a9202" returned: 0 in 0.352s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Deleted volume successfully.
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-quobyte-97516413-da3b-41be-b63a-02f6110a9202" released by "delete_volume" :: held 0.875s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-80201879-3eb8-4713-ad1a-d2c68c793686 tempest-CreateVolumesFromSnapshotTest-263665741 None] Lock "cinder-beb9fe1b-bfa8-4e1c-a68d-34f3f757640d-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Created reservations ['685d572a-59b0-4600-99fb-a26d041119e5', '6b5b803b-8ecb-4fad-8a13-ec5558bccc23', '4840ed25-7b6e-402b-b571-ccbc8818ce40', '8329e620-37a8-4e02-821f-c1c6f9cdd9ce'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:36 devstack sudo[100413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:36 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:36 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5 1073741824" returned: 0 in 0.602s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:36 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.349s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Deleted volume successfully.
Jul 14 18:00:36 devstack sudo[100417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5
Jul 14 18:00:36 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e1b5e26d-b43d-4f67-bb88-5dc1989b3c45 tempest-VolumeDependencyTests-366073106 None] Lock "cinder-97516413-da3b-41be-b63a-02f6110a9202-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:36 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5" returned: 0 in 0.353s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979e7f16-2800-4b37-87a0-e60b1f9bb9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f23faf0-592e-496d-830a-6dcc0a41f10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:37 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Volume volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5 (8156b20f-7f57-413d-84c4-37dfe9bb8aa5): created successfully
Jul 14 18:00:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f23faf0-592e-496d-830a-6dcc0a41f10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Flow 'volume_create_manager' (b5084441-6ad2-48cb-8d04-af62e992dc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3331252b-92d4-4aba-9148-31a1d7e27d84 tempest-VolumesTransfersV357Test-35320915 None] Created volume successfully.
Jul 14 18:00:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Acquiring lock "cinder-8156b20f-7f57-413d-84c4-37dfe9bb8aa5-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Lock "cinder-8156b20f-7f57-413d-84c4-37dfe9bb8aa5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Acquiring lock "cinder-quobyte-8156b20f-7f57-413d-84c4-37dfe9bb8aa5" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Lock "cinder-quobyte-8156b20f-7f57-413d-84c4-37dfe9bb8aa5" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e7ac8d-ab7f-4abe-a88f-959303727f52]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:38 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5
Jul 14 18:00:38 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:38 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5" returned: 0 in 0.418s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:38 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5
Jul 14 18:00:38 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:39 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8156b20f-7f57-413d-84c4-37dfe9bb8aa5" returned: 0 in 0.263s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Lock "cinder-quobyte-8156b20f-7f57-413d-84c4-37dfe9bb8aa5" released by "delete_volume" :: held 0.757s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:39 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Created reservations ['dd7d3bb2-a799-4673-b08e-3bdec97101e9', '2fc1d615-e9d6-4616-899a-d245cf114975', 'c6aa1e18-1045-4040-a07f-2c59e79b2585', '18c1ad74-ec9a-4a92-9c63-22d0ea06fd35'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:39 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:39 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:39 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.297s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:39 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Deleted volume successfully.
Jul 14 18:00:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-84d64ab1-ed9a-46ca-8273-637e9c311787 tempest-VolumesTransfersV357Test-741145805 None] Lock "cinder-8156b20f-7f57-413d-84c4-37dfe9bb8aa5-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Flow 'volume_create_manager' (2ff8e892-c434-451b-a716-7f270e5b6df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848a1556-1328-4419-a44b-289ac465c2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848a1556-1328-4419-a44b-289ac465c2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910642431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde87f79-7c92-4a06-9bab-7d69b417f3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c128fb5bb24f47ddbdf40eb238efa2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:43Z,use_quota=True,user_id='1b5207a1e20644efbd61da369a91962b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7ef541-0185-4b50-b956-27b0f724019a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f7ef541-0185-4b50-b956-27b0f724019a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c44e377-ea35-4c03-b1f0-f4e9462e3a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c44e377-ea35-4c03-b1f0-f4e9462e3a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde87f79-7c92-4a06-9bab-7d69b417f3b6', 'volume_name': 'volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1172a5b6-c4cc-4fd0-917c-72cfe28d9483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1172a5b6-c4cc-4fd0-917c-72cfe28d9483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815a9e93-37ac-4208-b09d-5de92f450e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:42 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Volume dde87f79-7c92-4a06-9bab-7d69b417f3b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6', 'volume_size': 1}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910642431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde87f79-7c92-4a06-9bab-7d69b417f3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c128fb5bb24f47ddbdf40eb238efa2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:43Z,use_quota=True,user_id='1b5207a1e20644efbd61da369a91962b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Creating volume dde87f79-7c92-4a06-9bab-7d69b417f3b6 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:42 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:42 devstack sudo[100470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6 1073741824
Jul 14 18:00:42 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:43 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6 1073741824" returned: 0 in 0.614s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:43 devstack sudo[100477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6
Jul 14 18:00:43 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:43 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6" returned: 0 in 0.364s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815a9e93-37ac-4208-b09d-5de92f450e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8226b863-7b9e-4e62-bd84-7f965a1659e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:43 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Volume volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6 (dde87f79-7c92-4a06-9bab-7d69b417f3b6): created successfully
Jul 14 18:00:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8226b863-7b9e-4e62-bd84-7f965a1659e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:43 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Flow 'volume_create_manager' (2ff8e892-c434-451b-a716-7f270e5b6df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bbc1a6c8-4478-4693-a1a5-bc38a4b52daa tempest-ProjectReaderTests-1108963539 None] Created volume successfully.
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Flow 'volume_create_manager' (701ecc5c-0812-4b1e-80dd-fb71a3c96b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc110de-9205-4e92-b0eb-2519bf2c3e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc110de-9205-4e92-b0eb-2519bf2c3e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585e68646c014b66af7cc843ef25f535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:45Z,use_quota=True,user_id='c955b66bcdf14e46a1d5b7deb157eceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9e892a-2db5-4832-b3ac-641b31c22199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9e892a-2db5-4832-b3ac-641b31c22199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d801b2f-689c-438e-8816-55ebd14074af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Acquiring lock "cinder-dde87f79-7c92-4a06-9bab-7d69b417f3b6-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Lock "cinder-dde87f79-7c92-4a06-9bab-7d69b417f3b6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Acquiring lock "cinder-quobyte-dde87f79-7c92-4a06-9bab-7d69b417f3b6" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Lock "cinder-quobyte-dde87f79-7c92-4a06-9bab-7d69b417f3b6" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a9129-7720-4b87-82fe-a1d226971ddf]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:45 devstack sudo[100480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6
Jul 14 18:00:45 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d801b2f-689c-438e-8816-55ebd14074af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da', 'volume_name': 'volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da', 'volume_size': 1, 'image_id': '494f15c0-2d0e-438b-8e53-60d74493bd90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/494f15c0-2d0e-438b-8e53-60d74493bd90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b605cd9a7d9f8409af44b991b5f04a92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '585e68646c014b66af7cc843ef25f535', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '257d15d74a705d2e0d1e4584845dfeb4749cd195a127cc0442e4fc5b84c6d26999d5389a90acd2c08e983dbd295735c9b71fd5ab4897c5ff2142605131503815', 'id': '494f15c0-2d0e-438b-8e53-60d74493bd90', 'created_at': datetime.datetime(2026, 7, 14, 16, 0, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 16, 0, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/494f15c0-2d0e-438b-8e53-60d74493bd90/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca262de0>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d50770c-4076-4192-b479-f0a2aa91a9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d50770c-4076-4192-b479-f0a2aa91a9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090eb2fa-82db-49f2-8aef-598d053e0ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:45 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Volume 8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da', 'volume_size': 1, 'image_id': '494f15c0-2d0e-438b-8e53-60d74493bd90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/494f15c0-2d0e-438b-8e53-60d74493bd90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b605cd9a7d9f8409af44b991b5f04a92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '585e68646c014b66af7cc843ef25f535', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '257d15d74a705d2e0d1e4584845dfeb4749cd195a127cc0442e4fc5b84c6d26999d5389a90acd2c08e983dbd295735c9b71fd5ab4897c5ff2142605131503815', 'id': '494f15c0-2d0e-438b-8e53-60d74493bd90', 'created_at': datetime.datetime(2026, 7, 14, 16, 0, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 16, 0, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/494f15c0-2d0e-438b-8e53-60d74493bd90/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca262de0>}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Trying to clone 8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da from image 494f15c0-2d0e-438b-8e53-60d74493bd90 at location (None, [{'url': 'file:///opt/stack/data/glance/images/494f15c0-2d0e-438b-8e53-60d74493bd90', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 18:00:45 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6" returned: 0 in 0.477s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:45 devstack sudo[100486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6
Jul 14 18:00:45 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:45 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 18:00:45 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Image download 0.00 MB at 0.00 MB/s
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[89026db3-6a83-411e-b119-5a87a9bf9978]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:46 devstack sudo[100488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD
Jul 14 18:00:46 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:46 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dde87f79-7c92-4a06-9bab-7d69b417f3b6" returned: 0 in 0.376s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Lock "cinder-quobyte-dde87f79-7c92-4a06-9bab-7d69b417f3b6" released by "delete_volume" :: held 0.918s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Created reservations ['48d70df7-8bc2-41e0-b6fc-32755ae9885f', '9db74afc-9f97-42b2-96a7-6ca6712abe3f', 'b07bd389-9cef-431c-9bee-5588a169aebc', 'b13f6479-be40-4b4d-b563-5fb6c47bce13'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:46 devstack sudo[100491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:46 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:46 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD" returned: 0 in 0.599s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:46 devstack sudo[100495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD
Jul 14 18:00:46 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:46 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.523s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Deleted volume successfully.
Jul 14 18:00:46 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=168,cinder:INSERT=59,cinder:UPDATE=230,cinder:DELETE=21 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5ed31132-0cbb-419a-b2ef-e13d0cb7a3fa tempest-ProjectReaderTests-1108963539 None] Lock "cinder-dde87f79-7c92-4a06-9bab-7d69b417f3b6-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:47 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD" returned: 1 in 0.492s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Temporary image 494f15c0-2d0e-438b-8e53-60d74493bd90 is fetched for user c955b66bcdf14e46a1d5b7deb157eceb. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cf3853-cde6-4a19-af60-a6a08bb99dd4]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Flow 'volume_create_manager' (bc85c1d4-154e-4a61-8de4-feeea88b2762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b18e5ca-c2bb-447f-81ec-b8cb972b18c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:47 devstack sudo[100501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD
Jul 14 18:00:47 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b18e5ca-c2bb-447f-81ec-b8cb972b18c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-137020484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc391ce-0dac-4800-83e4-5d8bf5e7c010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c128fb5bb24f47ddbdf40eb238efa2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:47Z,use_quota=True,user_id='1b5207a1e20644efbd61da369a91962b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18098ccd-67ed-438c-965c-c689ab59aaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18098ccd-67ed-438c-965c-c689ab59aaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398944fb-0ce1-471f-a11a-280bd1193807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398944fb-0ce1-471f-a11a-280bd1193807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc391ce-0dac-4800-83e4-5d8bf5e7c010', 'volume_name': 'volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e852f3-0027-4646-bbea-49cde890d9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e852f3-0027-4646-bbea-49cde890d9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29a9b74-d7c3-4cc6-b68d-d22ac36f1eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:47 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Volume ccc391ce-0dac-4800-83e4-5d8bf5e7c010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010', 'volume_size': 1}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-137020484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc391ce-0dac-4800-83e4-5d8bf5e7c010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c128fb5bb24f47ddbdf40eb238efa2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:47Z,use_quota=True,user_id='1b5207a1e20644efbd61da369a91962b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Creating volume ccc391ce-0dac-4800-83e4-5d8bf5e7c010 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:47 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:47 devstack sudo[100503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010 1073741824
Jul 14 18:00:47 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (8a968e64-bcf9-4740-b0a6-63da2fcebeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0988e6-9e83-4973-9972-21579ea5e2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0988e6-9e83-4973-9972-21579ea5e2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-334564248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db698dd6-9458-4e91-b118-e51652655aeb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:48Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573b69eb-f2e6-41cd-ad91-df357cca9c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573b69eb-f2e6-41cd-ad91-df357cca9c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d2cee3-4f10-47c0-b5f0-8fe0e0b04c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d2cee3-4f10-47c0-b5f0-8fe0e0b04c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db698dd6-9458-4e91-b118-e51652655aeb', 'volume_name': 'volume-db698dd6-9458-4e91-b118-e51652655aeb', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c6fc78-f800-4ef0-a25d-45c312bc5f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:47 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c6fc78-f800-4ef0-a25d-45c312bc5f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab65ef6-986e-42db-90fa-c4d6aa617e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:47 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Volume db698dd6-9458-4e91-b118-e51652655aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db698dd6-9458-4e91-b118-e51652655aeb', 'volume_size': 1}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD" returned: 0 in 0.620s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:48 devstack sudo[100509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD
Jul 14 18:00:48 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:48 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010 1073741824" returned: 0 in 0.636s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:48 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD" returned: 1 in 0.441s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:48 devstack sudo[100516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010
Jul 14 18:00:48 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:48 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010" returned: 0 in 0.283s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.709s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-334564248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db698dd6-9458-4e91-b118-e51652655aeb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:48Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Creating volume db698dd6-9458-4e91-b118-e51652655aeb {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:48 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-db698dd6-9458-4e91-b118-e51652655aeb 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:48 devstack sudo[100519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-db698dd6-9458-4e91-b118-e51652655aeb 1073741824
Jul 14 18:00:48 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29a9b74-d7c3-4cc6-b68d-d22ac36f1eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ad3311-3b46-48a5-bf06-e057c4ccd903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:48 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Volume volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010 (ccc391ce-0dac-4800-83e4-5d8bf5e7c010): created successfully
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ad3311-3b46-48a5-bf06-e057c4ccd903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Flow 'volume_create_manager' (bc85c1d4-154e-4a61-8de4-feeea88b2762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2826a408-5f1f-4d02-b948-3400d7d40733 tempest-ProjectReaderTests-1108963539 None] Created volume successfully.
Jul 14 18:00:49 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-db698dd6-9458-4e91-b118-e51652655aeb 1073741824" returned: 0 in 0.521s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-db698dd6-9458-4e91-b118-e51652655aeb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:49 devstack sudo[100525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-db698dd6-9458-4e91-b118-e51652655aeb
Jul 14 18:00:49 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:49 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Acquiring lock "cinder-ccc391ce-0dac-4800-83e4-5d8bf5e7c010-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-db698dd6-9458-4e91-b118-e51652655aeb" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.186s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585e68646c014b66af7cc843ef25f535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:45Z,use_quota=True,user_id='c955b66bcdf14e46a1d5b7deb157eceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Creating volume 8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:49 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:49 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da 1073741824
Jul 14 18:00:49 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Lock "cinder-ccc391ce-0dac-4800-83e4-5d8bf5e7c010-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab65ef6-986e-42db-90fa-c4d6aa617e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db698dd6-9458-4e91-b118-e51652655aeb', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459f4855-4449-4f07-a13f-3405de7ceca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:49 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Volume volume-db698dd6-9458-4e91-b118-e51652655aeb (db698dd6-9458-4e91-b118-e51652655aeb): created successfully
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459f4855-4449-4f07-a13f-3405de7ceca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (8a968e64-bcf9-4740-b0a6-63da2fcebeae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6005c16f-bcaa-46bd-862c-fff0adb449b5 tempest-VolumesGetTest-920675126 None] Created volume successfully.
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Acquiring lock "cinder-quobyte-ccc391ce-0dac-4800-83e4-5d8bf5e7c010" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Lock "cinder-quobyte-ccc391ce-0dac-4800-83e4-5d8bf5e7c010" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[02def0b5-806d-48ed-9855-8ecdc9ee1fc6]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:49 devstack sudo[100531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010
Jul 14 18:00:49 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:50 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da 1073741824" returned: 0 in 0.801s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:50 devstack sudo[100540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da
Jul 14 18:00:50 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:50 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010" returned: 0 in 0.701s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:50 devstack sudo[100543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010
Jul 14 18:00:50 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:50 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:50 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Attempting download of 494f15c0-2d0e-438b-8e53-60d74493bd90 ((None, [{'url': 'file:///opt/stack/data/glance/images/494f15c0-2d0e-438b-8e53-60d74493bd90', 'metadata': {}}])) to volume 8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 18:00:50 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb4c52b-36a0-4b9e-82cd-912ce6238a7d]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_494f15c0-2d0e-438b-8e53-60d74493bd90_5gcifsyg {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ccc391ce-0dac-4800-83e4-5d8bf5e7c010" returned: 0 in 0.419s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Lock "cinder-quobyte-ccc391ce-0dac-4800-83e4-5d8bf5e7c010" released by "delete_volume" :: held 1.226s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Created reservations ['056a2738-c2c0-45d6-8a22-825fbaa07a9e', '1d8d74bf-aced-4e64-9c98-a44da822cc68', 'd2940236-2774-4114-9d43-83531d81f4d0', '5eb0b065-5de0-43f8-bfbc-1aeb6438506b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:51 devstack sudo[100548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_494f15c0-2d0e-438b-8e53-60d74493bd90_5gcifsyg
Jul 14 18:00:51 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:51 devstack sudo[100550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:51 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Flow 'volume_create_manager' (5783ce53-682a-42f6-a48c-053c5051ec7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125f45ad-7cde-44aa-a9da-0618d48ad1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:51 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (c71a38d9-886e-4e03-94c7-aa1e66b6a339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69ef1b7-1ae6-45fc-8303-710a4d9aa7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_494f15c0-2d0e-438b-8e53-60d74493bd90_5gcifsyg" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_494f15c0-2d0e-438b-8e53-60d74493bd90_5gcifsyg {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125f45ad-7cde-44aa-a9da-0618d48ad1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-949773471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ff53cc-c4a3-4c36-8534-f29468d29a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6362800f0b6b43f1a402d9f74d96c1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:51Z,use_quota=True,user_id='885ffab0cd9149b9ad402a268d550bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438dedc4-a826-41c4-960c-d8be7607a22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438dedc4-a826-41c4-960c-d8be7607a22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fb1a3a-21cc-451e-940b-69feb6374e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fb1a3a-21cc-451e-940b-69feb6374e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ff53cc-c4a3-4c36-8534-f29468d29a8c', 'volume_name': 'volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e408e76-92be-4f68-b4b6-9b87325c3491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e408e76-92be-4f68-b4b6-9b87325c3491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:51 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ba2616-db3d-4cf4-a45a-d31748befd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:51 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Volume c5ff53cc-c4a3-4c36-8534-f29468d29a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c', 'volume_size': 1}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-949773471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ff53cc-c4a3-4c36-8534-f29468d29a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6362800f0b6b43f1a402d9f74d96c1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:51Z,use_quota=True,user_id='885ffab0cd9149b9ad402a268d550bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Creating volume c5ff53cc-c4a3-4c36-8534-f29468d29a8c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:51 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69ef1b7-1ae6-45fc-8303-710a4d9aa7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2010165930',display_name='tempest-VolumesGetTest-Volume-1564282478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43d8335-f53a-449c-80d9-938f2bbb67a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:51Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ff2435-1ec4-4471-ac77-e42e55bc8371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:51 devstack sudo[100557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c 1073741824
Jul 14 18:00:51 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ff2435-1ec4-4471-ac77-e42e55bc8371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49e4d9e-d030-4143-980f-447930f2578f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49e4d9e-d030-4143-980f-447930f2578f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c43d8335-f53a-449c-80d9-938f2bbb67a6', 'volume_name': 'volume-c43d8335-f53a-449c-80d9-938f2bbb67a6', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:51 devstack sudo[100555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_494f15c0-2d0e-438b-8e53-60d74493bd90_5gcifsyg
Jul 14 18:00:51 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50788da-f653-4a00-8142-75ce7073e991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50788da-f653-4a00-8142-75ce7073e991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711d7b85-0b50-4d3c-9d75-fc25ee74e158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:51 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Volume c43d8335-f53a-449c-80d9-938f2bbb67a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c43d8335-f53a-449c-80d9-938f2bbb67a6', 'volume_size': 1}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.327s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Deleted volume successfully.
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1be717d1-76a6-4798-9be1-c4669f90132d tempest-ProjectReaderTests-1108963539 None] Lock "cinder-ccc391ce-0dac-4800-83e4-5d8bf5e7c010-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:51 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_494f15c0-2d0e-438b-8e53-60d74493bd90_5gcifsyg" returned: 1 in 0.328s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_494f15c0-2d0e-438b-8e53-60d74493bd90_5gcifsyg' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c5ee96-ba7f-4fd5-ae39-eeddd03ca273]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:51 devstack sudo[100565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD
Jul 14 18:00:51 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:51 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c 1073741824" returned: 0 in 0.454s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:51 devstack sudo[100567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c
Jul 14 18:00:51 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:52 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:52 devstack sudo[100571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD
Jul 14 18:00:52 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:52 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" returned: 0 in 0.297s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2010165930',display_name='tempest-VolumesGetTest-Volume-1564282478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43d8335-f53a-449c-80d9-938f2bbb67a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:51Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Creating volume c43d8335-f53a-449c-80d9-938f2bbb67a6 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:52 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c43d8335-f53a-449c-80d9-938f2bbb67a6 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ba2616-db3d-4cf4-a45a-d31748befd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177de23f-e2ac-42cf-b7df-47bda2715727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:52 devstack sudo[100574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c43d8335-f53a-449c-80d9-938f2bbb67a6 1073741824
Jul 14 18:00:52 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:52 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Volume volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c (c5ff53cc-c4a3-4c36-8534-f29468d29a8c): created successfully
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177de23f-e2ac-42cf-b7df-47bda2715727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Flow 'volume_create_manager' (5783ce53-682a-42f6-a48c-053c5051ec7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1c025cc4-f1df-4754-b66b-216dc8ab511d tempest-VolumesActionsTest-1829391407 None] Created volume successfully.
Jul 14 18:00:52 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] 494f15c0-2d0e-438b-8e53-60d74493bd90 was raw, converting to raw {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:52 devstack sudo[100579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da
Jul 14 18:00:52 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:52 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c43d8335-f53a-449c-80d9-938f2bbb67a6 1073741824" returned: 0 in 0.488s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c43d8335-f53a-449c-80d9-938f2bbb67a6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:52 devstack sudo[100588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c43d8335-f53a-449c-80d9-938f2bbb67a6
Jul 14 18:00:52 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:52 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da" returned: 0 in 0.403s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_494f15c0-2d0e-438b-8e53-60d74493bd90_e263s_r2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:00:52 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Converted 0.00 MB image at 0.00 MB/s
Jul 14 18:00:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:52 devstack sudo[100590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da 1G
Jul 14 18:00:52 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:53 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c43d8335-f53a-449c-80d9-938f2bbb67a6" returned: 0 in 0.316s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:00:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711d7b85-0b50-4d3c-9d75-fc25ee74e158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c43d8335-f53a-449c-80d9-938f2bbb67a6', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4240d9e-1d6a-436a-a588-f3669754ec86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:53 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Volume volume-c43d8335-f53a-449c-80d9-938f2bbb67a6 (c43d8335-f53a-449c-80d9-938f2bbb67a6): created successfully
Jul 14 18:00:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4240d9e-1d6a-436a-a588-f3669754ec86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (c71a38d9-886e-4e03-94c7-aa1e66b6a339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1a155461-8e93-4809-8c43-7a78b22eeaf3 tempest-VolumesGetTest-920675126 None] Created volume successfully.
Jul 14 18:00:53 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da 1G" returned: 0 in 0.413s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:53 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aeb242-1e9f-43d6-b456-e92042a1a6b7]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:53 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da
Jul 14 18:00:53 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:53 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:53 devstack sudo[100600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da
Jul 14 18:00:53 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:54 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da" returned: 1 in 0.439s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Downloaded image 494f15c0-2d0e-438b-8e53-60d74493bd90 ((None, [{'url': 'file:///opt/stack/data/glance/images/494f15c0-2d0e-438b-8e53-60d74493bd90', 'metadata': {}}])) to volume 8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Temporary image 494f15c0-2d0e-438b-8e53-60d74493bd90 for user c955b66bcdf14e46a1d5b7deb157eceb is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Marking volume 8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Copying metadata from image 494f15c0-2d0e-438b-8e53-60d74493bd90 to 8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Creating volume glance metadata for volume 8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da backed by image 494f15c0-2d0e-438b-8e53-60d74493bd90 with: {'image_id': '494f15c0-2d0e-438b-8e53-60d74493bd90', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b605cd9a7d9f8409af44b991b5f04a92', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090eb2fa-82db-49f2-8aef-598d053e0ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da', 'volume_size': 1, 'image_id': '494f15c0-2d0e-438b-8e53-60d74493bd90', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/494f15c0-2d0e-438b-8e53-60d74493bd90', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b605cd9a7d9f8409af44b991b5f04a92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '585e68646c014b66af7cc843ef25f535', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '257d15d74a705d2e0d1e4584845dfeb4749cd195a127cc0442e4fc5b84c6d26999d5389a90acd2c08e983dbd295735c9b71fd5ab4897c5ff2142605131503815', 'id': '494f15c0-2d0e-438b-8e53-60d74493bd90', 'created_at': datetime.datetime(2026, 7, 14, 16, 0, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 16, 0, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/494f15c0-2d0e-438b-8e53-60d74493bd90/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca262de0>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce5a6ec-47f4-4a58-ac6b-9651a7281318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:54 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Volume volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da (8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da): created successfully
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce5a6ec-47f4-4a58-ac6b-9651a7281318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Flow 'volume_create_manager' (701ecc5c-0812-4b1e-80dd-fb71a3c96b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0f14482e-311f-45a3-8804-992164b2f106 tempest-VolumeImageDependencyTests-1285733805 None] Created volume successfully.
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-c43d8335-f53a-449c-80d9-938f2bbb67a6-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Lock "cinder-c43d8335-f53a-449c-80d9-938f2bbb67a6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-quobyte-c43d8335-f53a-449c-80d9-938f2bbb67a6" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-c43d8335-f53a-449c-80d9-938f2bbb67a6" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1cf156-5eff-4f71-9916-863d026faf03]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c43d8335-f53a-449c-80d9-938f2bbb67a6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:54 devstack sudo[100614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c43d8335-f53a-449c-80d9-938f2bbb67a6
Jul 14 18:00:54 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:54 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c43d8335-f53a-449c-80d9-938f2bbb67a6" returned: 0 in 0.409s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c43d8335-f53a-449c-80d9-938f2bbb67a6 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:54 devstack sudo[100620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c43d8335-f53a-449c-80d9-938f2bbb67a6
Jul 14 18:00:54 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:55 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c43d8335-f53a-449c-80d9-938f2bbb67a6" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-c43d8335-f53a-449c-80d9-938f2bbb67a6" released by "delete_volume" :: held 0.769s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Created reservations ['22e24633-a477-42b2-aa29-a931765041c5', '1be265e6-9d00-4f0b-959e-c0e94ebcc709', 'e6661958-dcf1-4370-97c1-3301c9cf7196', '532badfa-1372-4941-acfb-7a5509907e37'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Acquiring lock "cinder-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:55 devstack sudo[100623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Lock "cinder-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:55 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Acquiring lock "cinder-quobyte-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Lock "cinder-quobyte-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da" acquired by "delete_volume" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[710bcd3a-aeb9-4552-b7b0-f0ec4f3bf5b8]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-db698dd6-9458-4e91-b118-e51652655aeb-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Lock "cinder-db698dd6-9458-4e91-b118-e51652655aeb-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-quobyte-db698dd6-9458-4e91-b118-e51652655aeb" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-db698dd6-9458-4e91-b118-e51652655aeb" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:00:55 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.514s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Deleted volume successfully.
Jul 14 18:00:55 devstack sudo[100625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da
Jul 14 18:00:55 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9b86a6-c0da-4521-ab88-b460ab83401e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-db698dd6-9458-4e91-b118-e51652655aeb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a6f014a3-bcb5-4db4-bc2e-3411a115b98f tempest-VolumesGetTest-920675126 None] Lock "cinder-c43d8335-f53a-449c-80d9-938f2bbb67a6-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:56 devstack sudo[100628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-db698dd6-9458-4e91-b118-e51652655aeb
Jul 14 18:00:56 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:56 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da" returned: 0 in 0.713s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:56 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-db698dd6-9458-4e91-b118-e51652655aeb" returned: 0 in 0.519s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-db698dd6-9458-4e91-b118-e51652655aeb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:56 devstack sudo[100634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da
Jul 14 18:00:56 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:56 devstack sudo[100636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-db698dd6-9458-4e91-b118-e51652655aeb
Jul 14 18:00:56 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:56 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da" returned: 1 in 0.566s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:00:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:56 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-db698dd6-9458-4e91-b118-e51652655aeb" returned: 0 in 0.498s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-db698dd6-9458-4e91-b118-e51652655aeb" released by "delete_volume" :: held 1.095s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:56 devstack sudo[100650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da
Jul 14 18:00:56 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Created reservations ['72239e8b-08b0-4d36-9c6a-efb90a559604', 'bb87fa64-ba33-4083-a520-5e405b59e480', '44792208-ebc9-4179-8233-9e92942b6455', '41c017de-ea69-4f61-9408-269899da48d6'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:57 devstack sudo[100658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:57 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:57 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da" returned: 0 in 0.426s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Lock "cinder-quobyte-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da" released by "delete_volume" :: held 1.840s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Created reservations ['1eeea80b-fa13-48f6-abb7-c42848d10fb9', '10379cad-cb72-45c3-b424-1bf0490ace63', '6dd2e4a1-2389-47e5-a5e3-b7050dc8cdbe', '8797950f-d124-4e8f-b966-8701563e87f0'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:57 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.471s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Deleted volume successfully.
Jul 14 18:00:57 devstack sudo[100664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:00:57 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-548ae277-75ac-48a3-83af-3481427971a6 tempest-VolumesGetTest-920675126 None] Lock "cinder-db698dd6-9458-4e91-b118-e51652655aeb-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:58 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.508s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:58 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:00:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Deleted volume successfully.
Jul 14 18:00:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-328b145f-c04e-4688-9c8b-3632d7dd51f3 tempest-VolumeImageDependencyTests-1285733805 None] Lock "cinder-8bcc3bef-5ddc-4e25-a5d5-c5e7e97302da-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (451270f7-ea72-4a27-8c64-bb64190745ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385c9efc-b1fe-4f34-97b3-2107067e2865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385c9efc-b1fe-4f34-97b3-2107067e2865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1706319008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20911628-9457-40b1-a6bb-943048583128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:59Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7b3afb-92a2-425d-96aa-a6b9fae6ef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7b3afb-92a2-425d-96aa-a6b9fae6ef53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e0289c-7c47-433c-ac89-dbbc0bb6f964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e0289c-7c47-433c-ac89-dbbc0bb6f964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20911628-9457-40b1-a6bb-943048583128', 'volume_name': 'volume-20911628-9457-40b1-a6bb-943048583128', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b4418f-b7a5-4cb8-ac65-3d91ccfc7550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b4418f-b7a5-4cb8-ac65-3d91ccfc7550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ff8d9e-cca3-4603-9bbe-549ebef56c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:00:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Volume 20911628-9457-40b1-a6bb-943048583128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20911628-9457-40b1-a6bb-943048583128', 'volume_size': 1}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1706319008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20911628-9457-40b1-a6bb-943048583128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:00:59Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Creating volume 20911628-9457-40b1-a6bb-943048583128 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:00:59 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:59 devstack sudo[100668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 1073741824
Jul 14 18:00:59 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:00:59 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 1073741824" returned: 0 in 0.587s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:00:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:00:59 devstack sudo[100675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128
Jul 14 18:00:59 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:00 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128" returned: 0 in 0.258s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:01:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ff8d9e-cca3-4603-9bbe-549ebef56c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20911628-9457-40b1-a6bb-943048583128', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577bf478-ddfc-4a7a-ae24-0472ea8e4e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Volume volume-20911628-9457-40b1-a6bb-943048583128 (20911628-9457-40b1-a6bb-943048583128): created successfully
Jul 14 18:01:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577bf478-ddfc-4a7a-ae24-0472ea8e4e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (451270f7-ea72-4a27-8c64-bb64190745ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-89644ed5-9b8b-4330-8a8a-6ca9f7fdcfdd tempest-VolumesGetTest-920675126 None] Created volume successfully.
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (d9124012-eb5f-4be9-a37a-7506c2770e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42aa2a0e-1d80-49d5-8b86-d67341369fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42aa2a0e-1d80-49d5-8b86-d67341369fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1345705186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8004606-a4be-4596-a774-92457f0a4ef1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=20911628-9457-40b1-a6bb-943048583128,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:02Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88058f60-45c5-43b9-bef6-1b7be1e52499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88058f60-45c5-43b9-bef6-1b7be1e52499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95660d05-23bb-49ff-b039-178e5858a17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95660d05-23bb-49ff-b039-178e5858a17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd8004606-a4be-4596-a774-92457f0a4ef1', 'volume_name': 'volume-d8004606-a4be-4596-a774-92457f0a4ef1', 'volume_size': 1, 'source_volid': '20911628-9457-40b1-a6bb-943048583128', 'source_volstatus': 'available'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28888a1f-ecbc-442d-923a-17c50b4e7d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28888a1f-ecbc-442d-923a-17c50b4e7d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014a99b3-6039-450c-a0eb-cadf05324ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Volume d8004606-a4be-4596-a774-92457f0a4ef1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d8004606-a4be-4596-a774-92457f0a4ef1', 'volume_size': 1, 'source_volid': '20911628-9457-40b1-a6bb-943048583128', 'source_volstatus': 'available'}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:02 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Cloning volume 20911628-9457-40b1-a6bb-943048583128 to volume d8004606-a4be-4596-a774-92457f0a4ef1
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Creating offline snapshot 6378e2eb-4a20-409a-830d-3a081227e74a of volume 20911628-9457-40b1-a6bb-943048583128 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce336f3-f428-4ee7-bf4f-e77ab1fd68bb]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:02 devstack sudo[100744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128
Jul 14 18:01:02 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:03 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128" returned: 0 in 0.710s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:03 devstack sudo[100751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a 1G
Jul 14 18:01:03 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b16034c1-caa9-4206-a1ba-3c510677700e tempest-VolumesActionsTest-1829391407 None] Acquiring lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" by "attach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b16034c1-caa9-4206-a1ba-3c510677700e tempest-VolumesActionsTest-1829391407 None] Lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" acquired by "attach_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b16034c1-caa9-4206-a1ba-3c510677700e tempest-VolumesActionsTest-1829391407 None] Attaching volume c5ff53cc-c4a3-4c36-8534-f29468d29a8c to instance 64900552-e849-49d7-a456-e97ba9d3d3a3 at mountpoint /dev/vdb on host None.
Jul 14 18:01:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b16034c1-caa9-4206-a1ba-3c510677700e tempest-VolumesActionsTest-1829391407 None] Attach volume completed successfully.
Jul 14 18:01:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b16034c1-caa9-4206-a1ba-3c510677700e tempest-VolumesActionsTest-1829391407 None] Lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" released by "attach_volume" :: held 0.188s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Flow 'volume_create_manager' (ffffaba4-ba86-40aa-ad19-dbf0e1d009f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24857260-e1f4-4763-aa31-a9e4a4592db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24857260-e1f4-4763-aa31-a9e4a4592db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1b461e-08d2-4828-ac77-39efadaad279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b28f2e24e48b483da5f4cf96377bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:04Z,use_quota=True,user_id='c8932af0a1cc477bbc4f1f7fc124098b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b29b86-da9b-4fde-b92d-a94360884e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b29b86-da9b-4fde-b92d-a94360884e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d45512-89bc-4801-a2a8-6eb56ae3edc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d45512-89bc-4801-a2a8-6eb56ae3edc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1b461e-08d2-4828-ac77-39efadaad279', 'volume_name': 'volume-4f1b461e-08d2-4828-ac77-39efadaad279', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636dadf4-88c4-4c89-a75c-b9e99a98b78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:04 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636dadf4-88c4-4c89-a75c-b9e99a98b78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d96ac84-3d3e-4ca8-9292-f6de77314464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Volume 4f1b461e-08d2-4828-ac77-39efadaad279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1b461e-08d2-4828-ac77-39efadaad279', 'volume_size': 1}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c22230a6-f92e-4eeb-ac90-e4aea0bae4b3 tempest-VolumesActionsTest-1829391407 None] Acquiring lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c-detach_volume" by "detach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a 1G" returned: 0 in 0.950s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20911628-9457-40b1-a6bb-943048583128 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c22230a6-f92e-4eeb-ac90-e4aea0bae4b3 tempest-VolumesActionsTest-1829391407 None] Lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c22230a6-f92e-4eeb-ac90-e4aea0bae4b3 tempest-VolumesActionsTest-1829391407 None] Detaching volume c5ff53cc-c4a3-4c36-8534-f29468d29a8c from instance 64900552-e849-49d7-a456-e97ba9d3d3a3.
Jul 14 18:01:04 devstack sudo[100761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20911628-9457-40b1-a6bb-943048583128 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a
Jul 14 18:01:04 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c22230a6-f92e-4eeb-ac90-e4aea0bae4b3 tempest-VolumesActionsTest-1829391407 None] Detach volume completed successfully.
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c22230a6-f92e-4eeb-ac90-e4aea0bae4b3 tempest-VolumesActionsTest-1829391407 None] Lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:04 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20911628-9457-40b1-a6bb-943048583128 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:04 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a is being set with open permissions: ugo+rw
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:04 devstack sudo[100767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a
Jul 14 18:01:04 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:04 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a" returned: 0 in 0.425s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:05 devstack sudo[100775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.info
Jul 14 18:01:05 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:05 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.info" returned: 0 in 0.512s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:05 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.info is being set with open permissions: ugo+rw
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:05 devstack sudo[100794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.info
Jul 14 18:01:05 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:05 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.info" returned: 0 in 0.354s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-quobyte-d8004606-a4be-4596-a774-92457f0a4ef1" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-d8004606-a4be-4596-a774-92457f0a4ef1" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] snapshot: 6378e2eb-4a20-409a-830d-3a081227e74a, volume: d8004606-a4be-4596-a774-92457f0a4ef1,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb432609-1661-4d86-a7ef-60803b0fa13d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:06 devstack sudo[100798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a
Jul 14 18:01:06 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:06 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a" returned: 0 in 0.512s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20911628-9457-40b1-a6bb-943048583128(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:01:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 18:01:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 18:01:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[732e476e-e16d-45b5-846d-9996c94570cd]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:06 devstack sudo[100805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128
Jul 14 18:01:06 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:06 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128" returned: 0 in 0.401s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:06 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Path /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 18:01:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:06 devstack sudo[100810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1
Jul 14 18:01:06 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:12 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1" returned: 0 in 5.437s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5adb409-5163-4837-b99e-01404c31bcd9]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:12 devstack sudo[100829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128
Jul 14 18:01:12 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:13 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128" returned: 0 in 0.614s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:01:13 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Converted 1024.00 MB image at 188.19 MB/s
Jul 14 18:01:13 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1 is being set with open permissions: ugo+rw
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:13 devstack sudo[100849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1
Jul 14 18:01:13 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:13 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1" returned: 0 in 0.252s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-d8004606-a4be-4596-a774-92457f0a4ef1" released by "_copy_volume_from_snapshot" :: held 7.322s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-quobyte-6378e2eb-4a20-409a-830d-3a081227e74a" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-6378e2eb-4a20-409a-830d-3a081227e74a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Deleting offline snapshot 6378e2eb-4a20-409a-830d-3a081227e74a of volume 20911628-9457-40b1-a6bb-943048583128 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] snapshot_file for this snap is: volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fbc834-c4ea-4ce7-a2ea-9f7858f23e10]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:13 devstack sudo[100852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a
Jul 14 18:01:13 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:13 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a" returned: 0 in 0.462s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20911628-9457-40b1-a6bb-943048583128(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e53770-0214-454f-888f-683de43222f8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:13 devstack sudo[100858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128
Jul 14 18:01:13 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:14 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128" returned: 0 in 0.386s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:14 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a
Jul 14 18:01:14 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:14 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a" returned: 0 in 0.563s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:14 devstack sudo[100905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a
Jul 14 18:01:14 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:14 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=160,cinder:INSERT=58,cinder:UPDATE=221,cinder:DELETE=16 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:01:15 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128.6378e2eb-4a20-409a-830d-3a081227e74a" returned: 0 in 0.587s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-6378e2eb-4a20-409a-830d-3a081227e74a" released by "_delete_snapshot" :: held 2.138s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.115s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.366s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1b461e-08d2-4828-ac77-39efadaad279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b28f2e24e48b483da5f4cf96377bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:04Z,use_quota=True,user_id='c8932af0a1cc477bbc4f1f7fc124098b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Creating volume 4f1b461e-08d2-4828-ac77-39efadaad279 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:01:15 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4f1b461e-08d2-4828-ac77-39efadaad279 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014a99b3-6039-450c-a0eb-cadf05324ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8004606-a4be-4596-a774-92457f0a4ef1', 'volume_size': 1, 'source_volid': '20911628-9457-40b1-a6bb-943048583128', 'source_volstatus': 'available'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:15 devstack sudo[100938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4f1b461e-08d2-4828-ac77-39efadaad279 1073741824
Jul 14 18:01:15 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43be7312-87a9-4aa4-9168-60aec9da6a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:15 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Volume volume-d8004606-a4be-4596-a774-92457f0a4ef1 (d8004606-a4be-4596-a774-92457f0a4ef1): created successfully
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43be7312-87a9-4aa4-9168-60aec9da6a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (d9124012-eb5f-4be9-a37a-7506c2770e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-43a418c7-8336-4529-9474-ce64822912fc tempest-VolumesGetTest-920675126 None] Created volume successfully.
Jul 14 18:01:16 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4f1b461e-08d2-4828-ac77-39efadaad279 1073741824" returned: 0 in 0.534s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4f1b461e-08d2-4828-ac77-39efadaad279 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:16 devstack sudo[100949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4f1b461e-08d2-4828-ac77-39efadaad279
Jul 14 18:01:16 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:16 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4f1b461e-08d2-4828-ac77-39efadaad279" returned: 0 in 0.407s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:01:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d96ac84-3d3e-4ca8-9292-f6de77314464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1b461e-08d2-4828-ac77-39efadaad279', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb3bd37-a84b-4d93-82ff-1dcb3a422ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:16 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Volume volume-4f1b461e-08d2-4828-ac77-39efadaad279 (4f1b461e-08d2-4828-ac77-39efadaad279): created successfully
Jul 14 18:01:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb3bd37-a84b-4d93-82ff-1dcb3a422ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Flow 'volume_create_manager' (ffffaba4-ba86-40aa-ad19-dbf0e1d009f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-65a5c185-fda2-4ee6-8f75-d1bf761fddeb tempest-CinderUnicodeTest-1671044533 None] Created volume successfully.
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-385fa57e-f2c4-4131-a729-033df47f487b tempest-VolumesActionsTest-1829391407 None] Acquiring lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" by "attach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-385fa57e-f2c4-4131-a729-033df47f487b tempest-VolumesActionsTest-1829391407 None] Lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" acquired by "attach_volume" :: waited 0.040s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (5074f3f1-8071-4e2c-bce3-2677fe76f72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e83252-84b6-493f-9870-4cd3f4dccfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Flow 'volume_create_manager' (255972e3-4505-4d7b-a10f-04733a3de7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18944e9-1028-4613-99ed-a16cc573037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e83252-84b6-493f-9870-4cd3f4dccfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-748435194',display_name='tempest-VolumesGetTest-Volume-375125308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad778f8-d174-4051-8f38-d255c50702f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:18Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac4e001-20f2-4741-a469-973afca212a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac4e001-20f2-4741-a469-973afca212a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08064c0d-80fb-4ee7-9e58-9bb242640a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08064c0d-80fb-4ee7-9e58-9bb242640a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ad778f8-d174-4051-8f38-d255c50702f5', 'volume_name': 'volume-7ad778f8-d174-4051-8f38-d255c50702f5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07268a2a-cbde-4d3c-bd06-52600426550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07268a2a-cbde-4d3c-bd06-52600426550b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0f2206-e666-45c4-88f5-e5aa14da2342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Volume 7ad778f8-d174-4051-8f38-d255c50702f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ad778f8-d174-4051-8f38-d255c50702f5', 'volume_size': 1}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-748435194',display_name='tempest-VolumesGetTest-Volume-375125308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad778f8-d174-4051-8f38-d255c50702f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:18Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Creating volume 7ad778f8-d174-4051-8f38-d255c50702f5 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:01:18 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7ad778f8-d174-4051-8f38-d255c50702f5 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:18 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7ad778f8-d174-4051-8f38-d255c50702f5 1073741824
Jul 14 18:01:18 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18944e9-1028-4613-99ed-a16cc573037b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-198292937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1518c9dd-2437-48c7-8572-3d2f1407bc24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b28f2e24e48b483da5f4cf96377bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:18Z,use_quota=True,user_id='c8932af0a1cc477bbc4f1f7fc124098b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2de284-d75c-4534-8db7-733b00f0387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2de284-d75c-4534-8db7-733b00f0387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c05996-1dd3-4128-8788-4cfa86d0a969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c05996-1dd3-4128-8788-4cfa86d0a969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1518c9dd-2437-48c7-8572-3d2f1407bc24', 'volume_name': 'volume-1518c9dd-2437-48c7-8572-3d2f1407bc24', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a414e6a1-ae2d-49de-b2c0-f7d8991966bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a414e6a1-ae2d-49de-b2c0-f7d8991966bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad4567d-58ff-46c0-aa2d-5e4b27838c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Volume 1518c9dd-2437-48c7-8572-3d2f1407bc24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1518c9dd-2437-48c7-8572-3d2f1407bc24', 'volume_size': 1}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-385fa57e-f2c4-4131-a729-033df47f487b tempest-VolumesActionsTest-1829391407 None] Attaching volume c5ff53cc-c4a3-4c36-8534-f29468d29a8c to instance 59f4d2f3-9fab-4342-9dbd-8ba63942bfe4 at mountpoint /dev/vdb on host None.
Jul 14 18:01:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-385fa57e-f2c4-4131-a729-033df47f487b tempest-VolumesActionsTest-1829391407 None] Attach volume completed successfully.
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-385fa57e-f2c4-4131-a729-033df47f487b tempest-VolumesActionsTest-1829391407 None] Lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" released by "attach_volume" :: held 0.299s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1a4ffc35-b263-4337-b359-286e3f75365f tempest-VolumesActionsTest-1829391407 None] Acquiring lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c-detach_volume" by "detach_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1a4ffc35-b263-4337-b359-286e3f75365f tempest-VolumesActionsTest-1829391407 None] Lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1a4ffc35-b263-4337-b359-286e3f75365f tempest-VolumesActionsTest-1829391407 None] Detaching volume c5ff53cc-c4a3-4c36-8534-f29468d29a8c from instance 59f4d2f3-9fab-4342-9dbd-8ba63942bfe4.
Jul 14 18:01:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1a4ffc35-b263-4337-b359-286e3f75365f tempest-VolumesActionsTest-1829391407 None] Detach volume completed successfully.
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1a4ffc35-b263-4337-b359-286e3f75365f tempest-VolumesActionsTest-1829391407 None] Lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:18 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7ad778f8-d174-4051-8f38-d255c50702f5 1073741824" returned: 0 in 0.545s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7ad778f8-d174-4051-8f38-d255c50702f5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:18 devstack sudo[100959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7ad778f8-d174-4051-8f38-d255c50702f5
Jul 14 18:01:18 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:18 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7ad778f8-d174-4051-8f38-d255c50702f5" returned: 0 in 0.324s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-198292937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1518c9dd-2437-48c7-8572-3d2f1407bc24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6b28f2e24e48b483da5f4cf96377bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:18Z,use_quota=True,user_id='c8932af0a1cc477bbc4f1f7fc124098b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Creating volume 1518c9dd-2437-48c7-8572-3d2f1407bc24 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:01:18 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0f2206-e666-45c4-88f5-e5aa14da2342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad778f8-d174-4051-8f38-d255c50702f5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b8d16c-763b-4761-af52-61aa0dadaba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:18 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24 1073741824
Jul 14 18:01:18 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Volume volume-7ad778f8-d174-4051-8f38-d255c50702f5 (7ad778f8-d174-4051-8f38-d255c50702f5): created successfully
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b8d16c-763b-4761-af52-61aa0dadaba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (5074f3f1-8071-4e2c-bce3-2677fe76f72a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a54194b1-cd21-4f8a-a354-02a96eb6682d tempest-VolumesGetTest-920675126 None] Created volume successfully.
Jul 14 18:01:19 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24 1073741824" returned: 0 in 0.643s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:19 devstack sudo[100990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24
Jul 14 18:01:19 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-7ad778f8-d174-4051-8f38-d255c50702f5-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Lock "cinder-7ad778f8-d174-4051-8f38-d255c50702f5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-quobyte-7ad778f8-d174-4051-8f38-d255c50702f5" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-7ad778f8-d174-4051-8f38-d255c50702f5" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:19 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24" returned: 0 in 0.379s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad4567d-58ff-46c0-aa2d-5e4b27838c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1518c9dd-2437-48c7-8572-3d2f1407bc24', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22716064-8b02-4315-a3cf-f4e4b7493aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bbee66-9b12-4303-b2b5-9fbcc4c9b4d3]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7ad778f8-d174-4051-8f38-d255c50702f5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:20 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Volume volume-1518c9dd-2437-48c7-8572-3d2f1407bc24 (1518c9dd-2437-48c7-8572-3d2f1407bc24): created successfully
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22716064-8b02-4315-a3cf-f4e4b7493aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Flow 'volume_create_manager' (255972e3-4505-4d7b-a10f-04733a3de7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8ce77714-c039-46d3-8d01-07d5f8959b33 tempest-CinderUnicodeTest-1671044533 None] Created volume successfully.
Jul 14 18:01:20 devstack sudo[100994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7ad778f8-d174-4051-8f38-d255c50702f5
Jul 14 18:01:20 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:20 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7ad778f8-d174-4051-8f38-d255c50702f5" returned: 0 in 0.458s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7ad778f8-d174-4051-8f38-d255c50702f5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:20 devstack sudo[101000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7ad778f8-d174-4051-8f38-d255c50702f5
Jul 14 18:01:20 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:20 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7ad778f8-d174-4051-8f38-d255c50702f5" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-7ad778f8-d174-4051-8f38-d255c50702f5" released by "delete_volume" :: held 0.807s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:20 devstack sudo[101003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:01:20 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Created reservations ['030b4fc5-774e-4329-9bce-02bbc5d92956', '88a76ca5-5bc0-48d8-ba87-fb3e44151c2a', '44071bdc-f8c2-45f0-bc23-01fa2d4b6074', '751531be-ce7d-417c-afc3-45b052df2324'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:20 devstack sudo[101005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:01:20 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-d8004606-a4be-4596-a774-92457f0a4ef1-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:21 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.366s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Lock "cinder-d8004606-a4be-4596-a774-92457f0a4ef1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] Creating offline snapshot cd29bb05-cbc4-4f9d-85de-0d75c4ebc165 of volume 1518c9dd-2437-48c7-8572-3d2f1407bc24 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-quobyte-d8004606-a4be-4596-a774-92457f0a4ef1" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-d8004606-a4be-4596-a774-92457f0a4ef1" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:21 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46da44f-c89d-4de6-a005-6fe4d5382050]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.351s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3175fc-8469-40ec-9b30-8f01f3094864]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Deleted volume successfully.
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8ac34d91-c670-4ed4-8e33-ca4d081c7c0f tempest-VolumesGetTest-920675126 None] Lock "cinder-7ad778f8-d174-4051-8f38-d255c50702f5-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:21 devstack sudo[101009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24
Jul 14 18:01:21 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:21 devstack sudo[101010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1
Jul 14 18:01:21 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:21 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24" returned: 0 in 0.391s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:21 devstack sudo[101020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165 1G
Jul 14 18:01:21 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:21 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1" returned: 0 in 0.405s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:21 devstack sudo[101022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1
Jul 14 18:01:21 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:22 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d8004606-a4be-4596-a774-92457f0a4ef1" returned: 0 in 0.287s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-d8004606-a4be-4596-a774-92457f0a4ef1" released by "delete_volume" :: held 0.742s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Created reservations ['2c2c21ea-6e61-4001-8515-d98e34351c26', 'eb1189e3-1c5a-4ae1-bac2-a723995e06ad', '3d238ccf-50a5-407c-8146-d94671200be2', '24fade41-c42f-4341-abe6-f8b4fc160388'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:22 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165 1G" returned: 0 in 0.485s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1518c9dd-2437-48c7-8572-3d2f1407bc24 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:22 devstack sudo[101029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:01:22 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:22 devstack sudo[101030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1518c9dd-2437-48c7-8572-3d2f1407bc24 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165
Jul 14 18:01:22 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-20911628-9457-40b1-a6bb-943048583128-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Lock "cinder-20911628-9457-40b1-a6bb-943048583128-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-quobyte-20911628-9457-40b1-a6bb-943048583128" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-20911628-9457-40b1-a6bb-943048583128" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:22 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.349s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:01:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Deleted volume successfully.
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b25287b-9f65-4e74-b2bf-6039136ebeb7]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-80108086-f877-468d-85c5-bf9411de4235 tempest-VolumesGetTest-920675126 None] Lock "cinder-d8004606-a4be-4596-a774-92457f0a4ef1-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:22 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1518c9dd-2437-48c7-8572-3d2f1407bc24 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165" returned: 0 in 0.386s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:22 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165 is being set with open permissions: ugo+rw
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:22 devstack sudo[101039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165
Jul 14 18:01:22 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:22 devstack sudo[101038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128
Jul 14 18:01:22 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:22 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165" returned: 0 in 0.273s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:22 devstack sudo[101045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.info
Jul 14 18:01:22 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:22 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128" returned: 0 in 0.409s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:22 devstack sudo[101048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128
Jul 14 18:01:22 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:23 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.info" returned: 0 in 0.281s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:23 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.info is being set with open permissions: ugo+rw
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:23 devstack sudo[101051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.info
Jul 14 18:01:23 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:23 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20911628-9457-40b1-a6bb-943048583128" returned: 0 in 0.276s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-20911628-9457-40b1-a6bb-943048583128" released by "delete_volume" :: held 0.757s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Created reservations ['4ffaaa99-46b3-4177-9b07-80303a99c976', '8959f356-e51d-4752-8b3e-bd85d65dd7de', 'a8f39887-03bf-4dc8-9fe1-875aeafce0f3', 'fb4da547-ac83-46b8-93ef-f68d65aa2e45'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:23 devstack sudo[101054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:01:23 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:23 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.info" returned: 0 in 0.274s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.333s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7430894d-befa-4db6-97c6-4713329e52f2]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a38d6dc3-d10b-4bec-acc9-c1e26b53a483 tempest-CinderUnicodeTest-1671044533 None] Create snapshot completed successfully
Jul 14 18:01:23 devstack sudo[101057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c
Jul 14 18:01:23 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:23 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.282s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:01:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Deleted volume successfully.
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fc47a21c-4ef8-4093-a8ca-f9100a82ecb9 tempest-VolumesGetTest-920675126 None] Lock "cinder-20911628-9457-40b1-a6bb-943048583128-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:23 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" returned: 0 in 0.416s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[70792cf8-4893-4231-a39a-2811b1857a60]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:24 devstack sudo[101064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c
Jul 14 18:01:24 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:24 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.9e5ec5a6-170b-4e8e-b6f6-2bd5f57a456ahwwz1q2n.img {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:24 devstack sudo[101070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.9e5ec5a6-170b-4e8e-b6f6-2bd5f57a456ahwwz1q2n.img
Jul 14 18:01:24 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "cinder-cd29bb05-cbc4-4f9d-85de-0d75c4ebc165-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (db81dff4-1f7a-4d3b-8dde-b6ed14d06d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23abccb-48cd-4d98-9115-744e17ba4b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23abccb-48cd-4d98-9115-744e17ba4b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1387511213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39078521-0680-4dfb-a5c3-5102f159de09,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:24Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81b7995-25bf-477b-8425-fd2ea6e3ac90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81b7995-25bf-477b-8425-fd2ea6e3ac90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbc9969-7fa7-4132-9230-3bac2c4a98d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-cd29bb05-cbc4-4f9d-85de-0d75c4ebc165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "cinder-quobyte-1518c9dd-2437-48c7-8572-3d2f1407bc24" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-quobyte-1518c9dd-2437-48c7-8572-3d2f1407bc24" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "cinder-quobyte-cd29bb05-cbc4-4f9d-85de-0d75c4ebc165" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-quobyte-cd29bb05-cbc4-4f9d-85de-0d75c4ebc165" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Deleting offline snapshot cd29bb05-cbc4-4f9d-85de-0d75c4ebc165 of volume 1518c9dd-2437-48c7-8572-3d2f1407bc24 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] snapshot_file for this snap is: volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c355f84c-738c-4d34-962c-feb27674c6d0]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:25 devstack sudo[101075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165
Jul 14 18:01:25 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbc9969-7fa7-4132-9230-3bac2c4a98d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39078521-0680-4dfb-a5c3-5102f159de09', 'volume_name': 'volume-39078521-0680-4dfb-a5c3-5102f159de09', 'volume_size': 1, 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b35106125384bcf9ba800ba74e8254d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'created_at': datetime.datetime(2026, 7, 14, 15, 43, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 43, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3eef7b-9b54-4ea1-a240-6be757f56381/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2bfdf75f0>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccc0493-98bc-442e-b5e8-154dd8929d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ccc0493-98bc-442e-b5e8-154dd8929d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66597236-7a8e-46c6-8b04-dea45161efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:25 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Volume 39078521-0680-4dfb-a5c3-5102f159de09: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39078521-0680-4dfb-a5c3-5102f159de09', 'volume_size': 1, 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b35106125384bcf9ba800ba74e8254d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'created_at': datetime.datetime(2026, 7, 14, 15, 43, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 43, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3eef7b-9b54-4ea1-a240-6be757f56381/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2bfdf75f0>}
Jul 14 18:01:25 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Trying to clone 39078521-0680-4dfb-a5c3-5102f159de09 from image af3eef7b-9b54-4ea1-a240-6be757f56381 at location (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 18:01:25 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165" returned: 0 in 1.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1518c9dd-2437-48c7-8572-3d2f1407bc24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:01:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b99da9-e372-421b-8176-4d9786f7b216]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:26 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 18:01:26 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Image download 20.69 MB at 20.69 MB/s
Jul 14 18:01:26 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[573533e1-9684-4a4f-90a7-3d2fa60abe9e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:26 devstack sudo[101087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24
Jul 14 18:01:26 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:26 devstack sudo[101089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD
Jul 14 18:01:26 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:26 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24" returned: 0 in 0.972s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:26 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:26 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Temporary image af3eef7b-9b54-4ea1-a240-6be757f56381 is fetched for user 7ccdfd3e12084b7d8a59baf5802e8015. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 18:01:26 devstack sudo[101098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165
Jul 14 18:01:26 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c985a7-7682-4b83-9d4f-2226303592d8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:27 devstack sudo[101100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD
Jul 14 18:01:27 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:27 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165" returned: 0 in 0.798s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:27 devstack sudo[101106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165
Jul 14 18:01:27 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:28 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24.cd29bb05-cbc4-4f9d-85de-0d75c4ebc165" returned: 0 in 0.488s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-quobyte-cd29bb05-cbc4-4f9d-85de-0d75c4ebc165" released by "_delete_snapshot" :: held 3.734s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-quobyte-1518c9dd-2437-48c7-8572-3d2f1407bc24" released by "delete_snapshot" :: held 3.760s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:28 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD" returned: 0 in 1.230s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:28 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Created reservations ['75dd2cb1-5c17-4f1a-9e2c-a7bf710dec22', 'e3480766-b225-4522-857e-020611eab2a2', '1b4e577d-979f-430b-97ee-8658dd316ada', '86fb519a-4bcd-408a-9948-69159528c227'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:01:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Delete snapshot completed successfully.
Jul 14 18:01:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-88ae527a-6746-4d4f-9a22-8f8998557563 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-cd29bb05-cbc4-4f9d-85de-0d75c4ebc165-delete_snapshot" released by "delete_snapshot" :: held 4.027s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "cinder-1518c9dd-2437-48c7-8572-3d2f1407bc24-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-1518c9dd-2437-48c7-8572-3d2f1407bc24-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "cinder-quobyte-1518c9dd-2437-48c7-8572-3d2f1407bc24" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-quobyte-1518c9dd-2437-48c7-8572-3d2f1407bc24" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4fbf19-d0f5-438e-bf8c-63d4bc54da2a]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:29 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.9e5ec5a6-170b-4e8e-b6f6-2bd5f57a456ahwwz1q2n.img" returned: 0 in 4.952s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b54522-ce90-471c-b130-4479cce3e8b5]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:29 devstack sudo[101112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24
Jul 14 18:01:29 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:29 devstack sudo[101114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c
Jul 14 18:01:29 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:29 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24" returned: 0 in 0.366s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:29 devstack sudo[101120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24
Jul 14 18:01:29 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:29 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1518c9dd-2437-48c7-8572-3d2f1407bc24" returned: 0 in 0.239s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-quobyte-1518c9dd-2437-48c7-8572-3d2f1407bc24" released by "delete_volume" :: held 0.714s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:29 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" returned: 0 in 0.537s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.9e5ec5a6-170b-4e8e-b6f6-2bd5f57a456ahwwz1q2n.img {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:01:29 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] Converted 1024.00 MB image at 206.72 MB/s
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Created reservations ['2dc7ed92-6a2f-4b4c-817a-7ae2ded2e6e0', '282edc85-0a1e-4e75-81c7-67580c7a1209', '2b67e284-1772-41c0-ab53-7d07efd61020', 'b3d940c0-03c1-4726-9e53-bf22b5384642'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] 9e5ec5a6-170b-4e8e-b6f6-2bd5f57a456a was raw, no need to convert to raw {{(pid=87401) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:29 devstack sudo[101126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:01:29 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "cinder-4f1b461e-08d2-4828-ac77-39efadaad279-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-4f1b461e-08d2-4828-ac77-39efadaad279-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "cinder-quobyte-4f1b461e-08d2-4828-ac77-39efadaad279" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-quobyte-4f1b461e-08d2-4828-ac77-39efadaad279" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:30 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:01:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Deleted volume successfully.
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb26c5a-e2b1-47d1-8906-e92baa2aa266]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4f1b461e-08d2-4828-ac77-39efadaad279 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-132ec824-7c18-4666-b1a0-563755fd31f6 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-1518c9dd-2437-48c7-8572-3d2f1407bc24-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:30 devstack sudo[101129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4f1b461e-08d2-4828-ac77-39efadaad279
Jul 14 18:01:30 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:30 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4f1b461e-08d2-4828-ac77-39efadaad279" returned: 0 in 0.391s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4f1b461e-08d2-4828-ac77-39efadaad279 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:30 devstack sudo[101134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4f1b461e-08d2-4828-ac77-39efadaad279
Jul 14 18:01:30 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:30 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4f1b461e-08d2-4828-ac77-39efadaad279" returned: 0 in 0.256s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-quobyte-4f1b461e-08d2-4828-ac77-39efadaad279" released by "delete_volume" :: held 0.697s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:30 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Created reservations ['7b8a2658-9458-4abf-a2af-48c815965d27', '4954e8fc-d0d8-4f57-af56-9f748658a9b6', '9547b113-9c2e-4913-b9b2-f24d2a64a709', 'a30f7e54-d630-4466-9586-08f6503c8b2c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:01:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:31 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:31 devstack sudo[101137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:01:31 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:31 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.270s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:31 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:01:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Deleted volume successfully.
Jul 14 18:01:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c01e4671-9d54-42b0-8864-ca9a2d095f87 tempest-CinderUnicodeTest-1671044533 None] Lock "cinder-4f1b461e-08d2-4828-ac77-39efadaad279-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Flow 'volume_create_manager' (b16148d2-764a-4a0c-ad90-8284a20a0f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68658842-076a-49dd-98fd-656205f85662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68658842-076a-49dd-98fd-656205f85662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-853532765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fb81e2-b9d5-4031-973e-f160951ce97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f0f162e6ac4e4c96cb75c38a70884f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:35Z,use_quota=True,user_id='ac3d349321e04bcc8059429ed22ac536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b28997-fbef-4c2b-b330-af2d644c0628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b28997-fbef-4c2b-b330-af2d644c0628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f3be72-b916-433c-b8a8-5e12f8b9f818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f3be72-b916-433c-b8a8-5e12f8b9f818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9fb81e2-b9d5-4031-973e-f160951ce97e', 'volume_name': 'volume-f9fb81e2-b9d5-4031-973e-f160951ce97e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2867fc-e62a-4b8d-8d64-263aecc89058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2867fc-e62a-4b8d-8d64-263aecc89058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e8eec9-7ffa-4129-b5b0-0b19e945d323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:35 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Volume f9fb81e2-b9d5-4031-973e-f160951ce97e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9fb81e2-b9d5-4031-973e-f160951ce97e', 'volume_size': 1}
Jul 14 18:01:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:45 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=101,cinder:UPDATE=117,cinder:DELETE=13,cinder:INSERT=33 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:01:45 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=59,cinder:INSERT=14,cinder:SELECT=49,cinder:DELETE=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:01:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.312s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] Uploaded volume to glance image-id: 9e5ec5a6-170b-4e8e-b6f6-2bd5f57a456a. {{(pid=87401) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 14 18:01:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.396s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1387511213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39078521-0680-4dfb-a5c3-5102f159de09,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:24Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:01:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Creating volume 39078521-0680-4dfb-a5c3-5102f159de09 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:01:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:01:48 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:01:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:48 devstack sudo[101177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 1073741824
Jul 14 18:01:48 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6f88231e-97df-4069-823e-0122843dc8d1 tempest-VolumesActionsTest-1829391407 None] Copy volume to image completed successfully.
Jul 14 18:01:49 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 1073741824" returned: 0 in 0.446s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:49 devstack sudo[101183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09
Jul 14 18:01:49 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:49 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09" returned: 0 in 0.272s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.416s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-853532765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fb81e2-b9d5-4031-973e-f160951ce97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f0f162e6ac4e4c96cb75c38a70884f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:35Z,use_quota=True,user_id='ac3d349321e04bcc8059429ed22ac536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Creating volume f9fb81e2-b9d5-4031-973e-f160951ce97e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:01:49 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f9fb81e2-b9d5-4031-973e-f160951ce97e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:49 devstack sudo[101187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f9fb81e2-b9d5-4031-973e-f160951ce97e 1073741824
Jul 14 18:01:49 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Attempting download of af3eef7b-9b54-4ea1-a240-6be757f56381 ((None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}])) to volume 39078521-0680-4dfb-a5c3-5102f159de09. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3f0bb8-e2f5-4888-b04e-0e0568dcd108]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_ilyftwzf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:49 devstack sudo[101189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_ilyftwzf
Jul 14 18:01:49 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:50 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f9fb81e2-b9d5-4031-973e-f160951ce97e 1073741824" returned: 0 in 0.583s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:50 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_ilyftwzf" returned: 0 in 0.517s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_ilyftwzf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f9fb81e2-b9d5-4031-973e-f160951ce97e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:50 devstack sudo[101197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f9fb81e2-b9d5-4031-973e-f160951ce97e
Jul 14 18:01:50 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:50 devstack sudo[101196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_ilyftwzf
Jul 14 18:01:50 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:50 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f9fb81e2-b9d5-4031-973e-f160951ce97e" returned: 0 in 0.296s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.323s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[72867dd1-e9b6-41b2-9929-e3a733bc6499]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e8eec9-7ffa-4129-b5b0-0b19e945d323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fb81e2-b9d5-4031-973e-f160951ce97e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8043013-7e87-4ec4-9317-e20c5c711b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Volume volume-f9fb81e2-b9d5-4031-973e-f160951ce97e (f9fb81e2-b9d5-4031-973e-f160951ce97e): created successfully
Jul 14 18:01:50 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8043013-7e87-4ec4-9317-e20c5c711b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Flow 'volume_create_manager' (b16148d2-764a-4a0c-ad90-8284a20a0f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_ilyftwzf" returned: 1 in 0.424s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3eef7b-9b54-4ea1-a240-6be757f56381_ilyftwzf' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1672f24-8087-4316-88af-b76db704b840]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-72f2f3dd-13a0-4c91-bba5-1f3ce83a8c24 tempest-ProjectReaderTests-434991675 None] Created volume successfully.
Jul 14 18:01:50 devstack sudo[101205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c
Jul 14 18:01:50 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:50 devstack sudo[101206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD
Jul 14 18:01:50 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:50 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" returned: 0 in 0.397s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:50 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] af3eef7b-9b54-4ea1-a240-6be757f56381 was qcow2, converting to raw {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db5ed7-2603-4711-8985-d1b178f5b010]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:50 devstack sudo[101215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09
Jul 14 18:01:50 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:51 devstack sudo[101216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c
Jul 14 18:01:51 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Acquiring lock "cinder-f9fb81e2-b9d5-4031-973e-f160951ce97e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Lock "cinder-f9fb81e2-b9d5-4031-973e-f160951ce97e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Acquiring lock "cinder-quobyte-f9fb81e2-b9d5-4031-973e-f160951ce97e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:01:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Lock "cinder-quobyte-f9fb81e2-b9d5-4031-973e-f160951ce97e" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:01:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1cec80-32b6-4e89-ae68-ae67aa510a77]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f9fb81e2-b9d5-4031-973e-f160951ce97e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:51 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" returned: 0 in 0.433s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:51 devstack sudo[101228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img
Jul 14 18:01:51 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:51 devstack sudo[101226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f9fb81e2-b9d5-4031-973e-f160951ce97e
Jul 14 18:01:51 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:51 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f9fb81e2-b9d5-4031-973e-f160951ce97e" returned: 0 in 0.525s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f9fb81e2-b9d5-4031-973e-f160951ce97e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:51 devstack sudo[101245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f9fb81e2-b9d5-4031-973e-f160951ce97e
Jul 14 18:01:52 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:52 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f9fb81e2-b9d5-4031-973e-f160951ce97e" returned: 0 in 0.619s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Lock "cinder-quobyte-f9fb81e2-b9d5-4031-973e-f160951ce97e" released by "delete_volume" :: held 1.215s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:52 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Created reservations ['0a77b6c1-f089-4b87-acb8-f098ab0d3228', 'fc0660c6-77f3-4487-9c30-1de933fab233', '7a627f8a-b319-4175-ba1d-7073b7e9aa1c', '7b130cd2-6cf7-4a28-975b-5c58f0dd0ba2'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:53 devstack sudo[101248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:01:53 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:53 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.399s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:53 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:01:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Deleted volume successfully.
Jul 14 18:01:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-708292ae-cea0-4d5b-9d73-10ef1325a62f tempest-ProjectReaderTests-434991675 None] Lock "cinder-f9fb81e2-b9d5-4031-973e-f160951ce97e-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:01:53 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09" returned: 0 in 2.765s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:53 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af3eef7b-9b54-4ea1-a240-6be757f56381_s3kzscumdevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:01:53 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Converted 112.00 MB image at 40.50 MB/s
Jul 14 18:01:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:53 devstack sudo[101252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 1G
Jul 14 18:01:53 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:54 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 1G" returned: 0 in 0.732s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:54 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72531d7-0775-4279-9c30-7280f2a4cd69]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Flow 'volume_create_manager' (da04bdb0-4f23-4d00-bf24-e777a490bf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f26ede1e-0945-43c0-af70-3458229956fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f26ede1e-0945-43c0-af70-3458229956fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886561372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4f4ba9-398f-4eda-9fb5-12b5b1228f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f0f162e6ac4e4c96cb75c38a70884f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:54Z,use_quota=True,user_id='ac3d349321e04bcc8059429ed22ac536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b420d1-d343-4492-a9ac-5c2f736c42ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b420d1-d343-4492-a9ac-5c2f736c42ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97fd5aa-1032-40e5-988e-3857c84920bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97fd5aa-1032-40e5-988e-3857c84920bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4f4ba9-398f-4eda-9fb5-12b5b1228f48', 'volume_name': 'volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e56d4c2-a0e1-45ad-a6ae-b71508dab3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e56d4c2-a0e1-45ad-a6ae-b71508dab3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc390eb-88e9-4a22-9e95-de4581e00acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:55 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Volume dd4f4ba9-398f-4eda-9fb5-12b5b1228f48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48', 'volume_size': 1}
Jul 14 18:01:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:55 devstack sudo[101263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09
Jul 14 18:01:55 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:55 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09" returned: 0 in 1.070s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:55 devstack sudo[101267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09
Jul 14 18:01:55 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:56 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09" returned: 1 in 0.571s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Downloaded image af3eef7b-9b54-4ea1-a240-6be757f56381 ((None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}])) to volume 39078521-0680-4dfb-a5c3-5102f159de09 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Temporary image af3eef7b-9b54-4ea1-a240-6be757f56381 for user 7ccdfd3e12084b7d8a59baf5802e8015 is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Marking volume 39078521-0680-4dfb-a5c3-5102f159de09 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Copying metadata from image af3eef7b-9b54-4ea1-a240-6be757f56381 to 39078521-0680-4dfb-a5c3-5102f159de09. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Creating volume glance metadata for volume 39078521-0680-4dfb-a5c3-5102f159de09 backed by image af3eef7b-9b54-4ea1-a240-6be757f56381 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66597236-7a8e-46c6-8b04-dea45161efe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39078521-0680-4dfb-a5c3-5102f159de09', 'volume_size': 1, 'image_id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3eef7b-9b54-4ea1-a240-6be757f56381', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b35106125384bcf9ba800ba74e8254d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'af3eef7b-9b54-4ea1-a240-6be757f56381', 'created_at': datetime.datetime(2026, 7, 14, 15, 43, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 15, 43, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3eef7b-9b54-4ea1-a240-6be757f56381/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2bfdf75f0>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:56 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64777524-44b8-4db7-943f-eed52ad38ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img" returned: 0 in 5.014s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:56 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Volume volume-39078521-0680-4dfb-a5c3-5102f159de09 (39078521-0680-4dfb-a5c3-5102f159de09): created successfully
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64777524-44b8-4db7-943f-eed52ad38ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (db81dff4-1f7a-4d3b-8dde-b6ed14d06d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7799664d-b742-4f4f-927e-35165b48abbd]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:56 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-dbdf5c0f-b265-4cf7-991c-e134ce2a7deb tempest-VolumesGetTest-920675126 None] Created volume successfully.
Jul 14 18:01:56 devstack sudo[101272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c
Jul 14 18:01:56 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:56 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" returned: 0 in 0.508s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:01:56 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Converted 1024.00 MB image at 204.19 MB/s
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] 383ce14a-5725-4931-aef1-ca674e5e3f89 was raw, converting to qcow2 {{(pid=87401) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba85953-32d2-437d-b82a-1de284c65729]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:57 devstack sudo[101277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img
Jul 14 18:01:57 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:57 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img" returned: 0 in 0.320s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:57 devstack sudo[101281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img
Jul 14 18:01:57 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:57 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img" returned: 1 in 0.332s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img /opt/stack/data/cinder/conversion/vol_upload_2kru1tmv {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:57 devstack sudo[101286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img /opt/stack/data/cinder/conversion/vol_upload_2kru1tmv
Jul 14 18:01:57 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (c6df1b0b-51ba-403b-a276-92cb7249f38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:01:57 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45b915d-07a8-4378-9175-e2d3ceb2585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img /opt/stack/data/cinder/conversion/vol_upload_2kru1tmv" returned: 0 in 0.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Image conversion details: src /opt/stack/data/cinder/conversion/c5ff53cc-c4a3-4c36-8534-f29468d29a8c.temp_image.383ce14a-5725-4931-aef1-ca674e5e3f89txl5ixwp.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2kru1tmv {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:01:57 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a741d07a-3142-4464-b55b-7f8305050029]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2kru1tmv {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45b915d-07a8-4378-9175-e2d3ceb2585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-646333259',display_name='tempest-VolumesGetTest-Volume-1198929477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127bdc1a-a05c-4824-8949-b05e4a7da2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:58Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569312ac-210d-4fd9-8f01-05e3ade373ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569312ac-210d-4fd9-8f01-05e3ade373ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04935f72-11e2-429d-ab26-a7ad5208abe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04935f72-11e2-429d-ab26-a7ad5208abe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '127bdc1a-a05c-4824-8949-b05e4a7da2c7', 'volume_name': 'volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf767f0-9d30-49e4-985b-c4e8342a598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf767f0-9d30-49e4-985b-c4e8342a598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d906cb-b72c-45dc-854b-8ad185208ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:01:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Volume 127bdc1a-a05c-4824-8949-b05e4a7da2c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7', 'volume_size': 1}
Jul 14 18:01:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:58 devstack sudo[101292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2kru1tmv
Jul 14 18:01:58 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:58 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2kru1tmv" returned: 0 in 0.328s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.968s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Uploaded volume to glance image-id: 383ce14a-5725-4931-aef1-ca674e5e3f89. {{(pid=87401) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.472s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886561372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4f4ba9-398f-4eda-9fb5-12b5b1228f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f0f162e6ac4e4c96cb75c38a70884f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:54Z,use_quota=True,user_id='ac3d349321e04bcc8059429ed22ac536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Creating volume dd4f4ba9-398f-4eda-9fb5-12b5b1228f48 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:01:59 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:01:59 devstack sudo[101297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48 1073741824
Jul 14 18:01:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-12ce3b5b-8153-42ab-8569-15b8aa9b1a33 tempest-VolumesActionsTest-1829391407 None] Copy volume to image completed successfully.
Jul 14 18:01:59 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:01:59 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48 1073741824" returned: 0 in 0.468s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:01:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:00 devstack sudo[101304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48
Jul 14 18:02:00 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:00 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48" returned: 0 in 0.267s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.290s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:01:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-646333259',display_name='tempest-VolumesGetTest-Volume-1198929477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127bdc1a-a05c-4824-8949-b05e4a7da2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1651a6ee944ff2994575c326b2e750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:01:58Z,use_quota=True,user_id='7ccdfd3e12084b7d8a59baf5802e8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Creating volume 127bdc1a-a05c-4824-8949-b05e4a7da2c7 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:02:00 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Acquiring lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc390eb-88e9-4a22-9e95-de4581e00acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:00 devstack sudo[101307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7 1073741824
Jul 14 18:02:00 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7451ee4c-598e-4604-b7ba-bd7c55f72d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Volume volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48 (dd4f4ba9-398f-4eda-9fb5-12b5b1228f48): created successfully
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7451ee4c-598e-4604-b7ba-bd7c55f72d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Flow 'volume_create_manager' (da04bdb0-4f23-4d00-bf24-e777a490bf67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7d9608c2-ce57-4c45-a830-7d9a843dd5be tempest-ProjectReaderTests-434991675 None] Created volume successfully.
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Acquiring lock "cinder-quobyte-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Lock "cinder-quobyte-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[752978e5-9518-43cc-98c4-74dd61a54ea6]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:00 devstack sudo[101309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c
Jul 14 18:02:00 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:00 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7 1073741824" returned: 0 in 0.448s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:00 devstack sudo[101317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7
Jul 14 18:02:00 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:00 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" returned: 0 in 0.389s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:00 devstack sudo[101319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c
Jul 14 18:02:00 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Acquiring lock "cinder-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Lock "cinder-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Acquiring lock "cinder-quobyte-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:01 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Lock "cinder-quobyte-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d906cb-b72c-45dc-854b-8ad185208ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adb5be0-95ab-42c0-a253-f4709aa29f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:01 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d478c103-550f-4403-81ec-56ed7c7ab2a9]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Volume volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7 (127bdc1a-a05c-4824-8949-b05e4a7da2c7): created successfully
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adb5be0-95ab-42c0-a253-f4709aa29f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Flow 'volume_create_manager' (c6df1b0b-51ba-403b-a276-92cb7249f38f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Lock "cinder-quobyte-c5ff53cc-c4a3-4c36-8534-f29468d29a8c" released by "delete_volume" :: held 0.746s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e7325107-831e-4151-a262-46f5a89368f2 tempest-VolumesGetTest-920675126 None] Created volume successfully.
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Created reservations ['9f14a134-8d23-4afc-ba86-ab1b8e3e2e83', '82db989a-3f1c-4c8f-9c18-a2f166d6df33', '63dd6ff8-2bfa-4170-b234-e7be2d24b146', 'd0f95808-9bb3-4c43-bb3c-4552a83ce26e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:01 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48
Jul 14 18:02:01 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:01 devstack sudo[101325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:01 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:01 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48" returned: 0 in 0.376s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:01 devstack sudo[101332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48
Jul 14 18:02:01 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:01 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.270s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Deleted volume successfully.
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ccceb4fd-07b6-44d6-a650-a8e455993b13 tempest-VolumesActionsTest-1829391407 None] Lock "cinder-c5ff53cc-c4a3-4c36-8534-f29468d29a8c-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:01 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48" returned: 0 in 0.252s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Lock "cinder-quobyte-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48" released by "delete_volume" :: held 0.693s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Created reservations ['6435a1c1-b558-4773-9762-b88e9b27d8d2', 'fdc34ff8-dd4f-4d99-9e78-e1d008cf4197', 'e4447bea-1cf9-4f4e-a3f1-1b571bf6ed83', '7323497e-d689-4cd5-813e-b31226fcfeaf'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:01 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:01 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:02 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.325s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Deleted volume successfully.
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fff068cc-5ba6-4112-9764-433d0f815c66 tempest-ProjectReaderTests-434991675 None] Lock "cinder-dd4f4ba9-398f-4eda-9fb5-12b5b1228f48-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-127bdc1a-a05c-4824-8949-b05e4a7da2c7-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Lock "cinder-127bdc1a-a05c-4824-8949-b05e4a7da2c7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-quobyte-127bdc1a-a05c-4824-8949-b05e4a7da2c7" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-127bdc1a-a05c-4824-8949-b05e4a7da2c7" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22285d3-32f9-44f7-89a2-b9bb2a743b12]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:02 devstack sudo[101338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7
Jul 14 18:02:02 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Flow 'volume_create_manager' (3eb8ab8a-ba3b-4b12-94fd-6f896cc6482a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164bf855-c42f-4d73-9a94-13cd5cb942b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164bf855-c42f-4d73-9a94-13cd5cb942b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115659482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d52725-9c21-4792-8ab0-fd33b5c71d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f0f162e6ac4e4c96cb75c38a70884f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:03Z,use_quota=True,user_id='ac3d349321e04bcc8059429ed22ac536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32acedd2-e3d0-486c-b5a7-7944f4bda0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32acedd2-e3d0-486c-b5a7-7944f4bda0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1d97b3-037a-41e5-9b68-98f37d72e986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1d97b3-037a-41e5-9b68-98f37d72e986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d52725-9c21-4792-8ab0-fd33b5c71d9f', 'volume_name': 'volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcc1134-e44a-43f6-ba09-008e64240ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcc1134-e44a-43f6-ba09-008e64240ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b650c177-c435-4459-9a1a-e2736127e0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Volume 91d52725-9c21-4792-8ab0-fd33b5c71d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f', 'volume_size': 1}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115659482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d52725-9c21-4792-8ab0-fd33b5c71d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f0f162e6ac4e4c96cb75c38a70884f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:03Z,use_quota=True,user_id='ac3d349321e04bcc8059429ed22ac536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Creating volume 91d52725-9c21-4792-8ab0-fd33b5c71d9f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:02:02 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:02 devstack sudo[101342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f 1073741824
Jul 14 18:02:02 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:02 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7" returned: 0 in 0.415s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:02 devstack sudo[101345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7
Jul 14 18:02:02 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:03 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-127bdc1a-a05c-4824-8949-b05e4a7da2c7" returned: 0 in 0.296s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-127bdc1a-a05c-4824-8949-b05e4a7da2c7" released by "delete_volume" :: held 0.760s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Created reservations ['09f42bd0-73c7-4751-9fb1-401df7f67fc0', 'ef5a4c13-77fd-409b-8e35-51eb60b4ea85', '4b0e6cfb-7a26-405f-87de-4b4ff4732eea', '84a324b8-9c45-4284-9b62-40049e1a8eb7'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:03 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f 1073741824" returned: 0 in 0.542s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:03 devstack sudo[101353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:03 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:03 devstack sudo[101355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f
Jul 14 18:02:03 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-39078521-0680-4dfb-a5c3-5102f159de09-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:03 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Deleted volume successfully.
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Lock "cinder-39078521-0680-4dfb-a5c3-5102f159de09-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:03 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b650c177-c435-4459-9a1a-e2736127e0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82949ea-ddbb-4c14-bfd1-0d296311bab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8a572c6c-31b5-4f0d-88f7-652e691b6bde tempest-VolumesGetTest-920675126 None] Lock "cinder-127bdc1a-a05c-4824-8949-b05e4a7da2c7-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Acquiring lock "cinder-quobyte-39078521-0680-4dfb-a5c3-5102f159de09" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Volume volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f (91d52725-9c21-4792-8ab0-fd33b5c71d9f): created successfully
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82949ea-ddbb-4c14-bfd1-0d296311bab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Flow 'volume_create_manager' (3eb8ab8a-ba3b-4b12-94fd-6f896cc6482a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-39078521-0680-4dfb-a5c3-5102f159de09" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c60a3c4c-93ff-404c-b4d2-b1aa973f0b2d tempest-ProjectReaderTests-434991675 None] Created volume successfully.
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[08714747-68dc-4da1-9274-9ca7a3e87c23]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:03 devstack sudo[101359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09
Jul 14 18:02:03 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:04 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09" returned: 0 in 0.394s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:04 devstack sudo[101363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09
Jul 14 18:02:04 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:04 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09" returned: 1 in 0.414s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:04 devstack sudo[101368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09
Jul 14 18:02:04 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Acquiring lock "cinder-91d52725-9c21-4792-8ab0-fd33b5c71d9f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Lock "cinder-91d52725-9c21-4792-8ab0-fd33b5c71d9f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:04 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-39078521-0680-4dfb-a5c3-5102f159de09" returned: 0 in 0.278s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Lock "cinder-quobyte-39078521-0680-4dfb-a5c3-5102f159de09" released by "delete_volume" :: held 1.165s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Acquiring lock "cinder-quobyte-91d52725-9c21-4792-8ab0-fd33b5c71d9f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Lock "cinder-quobyte-91d52725-9c21-4792-8ab0-fd33b5c71d9f" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb68f4d-b058-4085-b292-056cdc51f83c]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Created reservations ['c21570bb-2a49-47d0-8a57-1e849a1fa3e8', '2abc672f-11eb-4a7b-b547-df3dec008444', 'c903c906-65a6-4a0d-bbdf-3f39baf93288', 'da632fa2-3bbc-41ac-99b8-3b8f0d12f332'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:05 devstack sudo[101371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f
Jul 14 18:02:05 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:05 devstack sudo[101372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:05 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:05 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Deleted volume successfully.
Jul 14 18:02:05 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f" returned: 0 in 0.445s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:05 devstack sudo[101381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-545a98bb-504b-4fa8-bea4-f393addd06d5 tempest-VolumesGetTest-920675126 None] Lock "cinder-39078521-0680-4dfb-a5c3-5102f159de09-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:05 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:05 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-91d52725-9c21-4792-8ab0-fd33b5c71d9f" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Lock "cinder-quobyte-91d52725-9c21-4792-8ab0-fd33b5c71d9f" released by "delete_volume" :: held 0.758s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Created reservations ['5dc366f5-9b5f-4360-b71a-3f18ccc37f94', '4f88830a-44db-4d43-bda3-615887957d77', '61dd6f33-81b2-43d5-8006-81f8a25450ea', '39406854-4263-4745-b573-824b54fefe24'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:05 devstack sudo[101384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:05 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:06 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Deleted volume successfully.
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d5ac42c7-147f-4866-9a37-de4f92b2c8ee tempest-ProjectReaderTests-434991675 None] Lock "cinder-91d52725-9c21-4792-8ab0-fd33b5c71d9f-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Flow 'volume_create_manager' (5b1afb6d-dc71-4dc7-ba5b-3eef7d75debe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1e5cda-e4a8-46be-b37c-7e0d2efc4966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1e5cda-e4a8-46be-b37c-7e0d2efc4966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1866110210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868b3b76-9dfc-42d7-a48a-7a36e980c16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f0f162e6ac4e4c96cb75c38a70884f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:07Z,use_quota=True,user_id='ac3d349321e04bcc8059429ed22ac536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b4d352-787b-473c-b5b4-18c6de61a0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b4d352-787b-473c-b5b4-18c6de61a0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb55d16c-52f0-4195-b610-7eaeddad68f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb55d16c-52f0-4195-b610-7eaeddad68f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '868b3b76-9dfc-42d7-a48a-7a36e980c16c', 'volume_name': 'volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30568e29-12b3-4c51-bc43-94be9811b1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30568e29-12b3-4c51-bc43-94be9811b1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0119a9-f189-47fa-b2b5-4f836e6e8b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Volume 868b3b76-9dfc-42d7-a48a-7a36e980c16c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c', 'volume_size': 1}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1866110210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868b3b76-9dfc-42d7-a48a-7a36e980c16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f0f162e6ac4e4c96cb75c38a70884f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:07Z,use_quota=True,user_id='ac3d349321e04bcc8059429ed22ac536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Creating volume 868b3b76-9dfc-42d7-a48a-7a36e980c16c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:02:06 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:02:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:06 devstack sudo[101387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c 1073741824
Jul 14 18:02:06 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:07 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c 1073741824" returned: 0 in 0.544s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:07 devstack sudo[101394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c
Jul 14 18:02:07 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:07 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c" returned: 0 in 0.282s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:02:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0119a9-f189-47fa-b2b5-4f836e6e8b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a873c1d0-bad4-4916-9011-10a39d846139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:07 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Volume volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c (868b3b76-9dfc-42d7-a48a-7a36e980c16c): created successfully
Jul 14 18:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a873c1d0-bad4-4916-9011-10a39d846139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Flow 'volume_create_manager' (5b1afb6d-dc71-4dc7-ba5b-3eef7d75debe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d2be2b13-11e2-4446-8f3e-2fb034970fd0 tempest-ProjectReaderTests-434991675 None] Created volume successfully.
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Flow 'volume_create_manager' (bb565d17-1260-4207-943e-d6c110039884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bdfa89-6ed6-4607-bd41-c42dd4c89f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bdfa89-6ed6-4607-bd41-c42dd4c89f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-334354314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f571fe5a-e963-442e-b590-3972a9f1ae63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9832bb9cfc3c4caba2e49ab2ca84dd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:08Z,use_quota=True,user_id='bde13984f2034595b787799cb609c120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aefd88a-7e3d-4f30-9ec6-edeb1366d3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aefd88a-7e3d-4f30-9ec6-edeb1366d3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82489cc7-247e-4a5c-9a6d-753c51e3a9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82489cc7-247e-4a5c-9a6d-753c51e3a9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f571fe5a-e963-442e-b590-3972a9f1ae63', 'volume_name': 'volume-f571fe5a-e963-442e-b590-3972a9f1ae63', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c25489f-9d70-4c76-8730-433b736f7493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c25489f-9d70-4c76-8730-433b736f7493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53ab96e-cdad-4d2c-afa5-f03945cb62d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:08 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Volume f571fe5a-e963-442e-b590-3972a9f1ae63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f571fe5a-e963-442e-b590-3972a9f1ae63', 'volume_size': 1}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-334354314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f571fe5a-e963-442e-b590-3972a9f1ae63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9832bb9cfc3c4caba2e49ab2ca84dd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:08Z,use_quota=True,user_id='bde13984f2034595b787799cb609c120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Creating volume f571fe5a-e963-442e-b590-3972a9f1ae63 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:02:08 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:08 devstack sudo[101397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 1073741824
Jul 14 18:02:08 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:08 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 1073741824" returned: 0 in 0.431s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:08 devstack sudo[101403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63
Jul 14 18:02:08 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Acquiring lock "cinder-868b3b76-9dfc-42d7-a48a-7a36e980c16c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Lock "cinder-868b3b76-9dfc-42d7-a48a-7a36e980c16c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Acquiring lock "cinder-quobyte-868b3b76-9dfc-42d7-a48a-7a36e980c16c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Lock "cinder-quobyte-868b3b76-9dfc-42d7-a48a-7a36e980c16c" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[356a8913-c6a1-4388-9aac-90e99dec446e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:08 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63" returned: 0 in 0.259s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53ab96e-cdad-4d2c-afa5-f03945cb62d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f571fe5a-e963-442e-b590-3972a9f1ae63', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cb7c33-2f1c-48d7-b864-6bee161c9d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:08 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Volume volume-f571fe5a-e963-442e-b590-3972a9f1ae63 (f571fe5a-e963-442e-b590-3972a9f1ae63): created successfully
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cb7c33-2f1c-48d7-b864-6bee161c9d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Flow 'volume_create_manager' (bb565d17-1260-4207-943e-d6c110039884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3eb711a5-a9c0-4cde-8c2f-e2c3ee5aecf1 tempest-VolumesCloneTest-1734230911 None] Created volume successfully.
Jul 14 18:02:08 devstack sudo[101406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c
Jul 14 18:02:08 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:09 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c" returned: 0 in 0.443s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:09 devstack sudo[101412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c
Jul 14 18:02:09 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Flow 'volume_create_manager' (c4746f66-54fe-4549-9b90-b5c00b1c33a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60523196-351f-4582-9524-342580fc5ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60523196-351f-4582-9524-342580fc5ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1836063840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcc9876-0771-4ec6-98f0-fd70c383621d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1acc7d0c1f5342a2bf114e4a43b1e0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:09Z,use_quota=True,user_id='83bf8488b64e4812a45ab2cfa3febb17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6491038f-8ed7-4d23-b930-dc72eba8ff05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6491038f-8ed7-4d23-b930-dc72eba8ff05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b55127-647f-484d-997b-420a759b3b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b55127-647f-484d-997b-420a759b3b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfcc9876-0771-4ec6-98f0-fd70c383621d', 'volume_name': 'volume-cfcc9876-0771-4ec6-98f0-fd70c383621d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42afbcd9-d638-4585-b335-f498ba42e686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42afbcd9-d638-4585-b335-f498ba42e686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41604dd-1851-49b5-beb2-5854b36653c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:09 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Volume cfcc9876-0771-4ec6-98f0-fd70c383621d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfcc9876-0771-4ec6-98f0-fd70c383621d', 'volume_size': 1}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1836063840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcc9876-0771-4ec6-98f0-fd70c383621d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1acc7d0c1f5342a2bf114e4a43b1e0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:09Z,use_quota=True,user_id='83bf8488b64e4812a45ab2cfa3febb17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Creating volume cfcc9876-0771-4ec6-98f0-fd70c383621d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:02:09 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfcc9876-0771-4ec6-98f0-fd70c383621d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:09 devstack sudo[101416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfcc9876-0771-4ec6-98f0-fd70c383621d 1073741824
Jul 14 18:02:09 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:09 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-868b3b76-9dfc-42d7-a48a-7a36e980c16c" returned: 0 in 0.289s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Lock "cinder-quobyte-868b3b76-9dfc-42d7-a48a-7a36e980c16c" released by "delete_volume" :: held 0.785s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Flow 'volume_create_manager' (acf8d09f-e313-4a7f-947d-44075d3e4e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f8319c-9879-4c1e-8c7c-be0b5de919e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f8319c-9879-4c1e-8c7c-be0b5de919e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1517889876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5b0a28-0718-439b-9b18-83061cdee299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9832bb9cfc3c4caba2e49ab2ca84dd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=f571fe5a-e963-442e-b590-3972a9f1ae63,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:10Z,use_quota=True,user_id='bde13984f2034595b787799cb609c120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4601b2-c2fe-4909-9d8b-f76b90d519c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4601b2-c2fe-4909-9d8b-f76b90d519c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f10bfa-0db5-4af8-979d-d6565804a217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f10bfa-0db5-4af8-979d-d6565804a217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4b5b0a28-0718-439b-9b18-83061cdee299', 'volume_name': 'volume-4b5b0a28-0718-439b-9b18-83061cdee299', 'volume_size': 2, 'source_volid': 'f571fe5a-e963-442e-b590-3972a9f1ae63', 'source_volstatus': 'available'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e0b0a6-6d94-45de-b13e-58a92f583106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e0b0a6-6d94-45de-b13e-58a92f583106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d72215-f359-4f7c-9040-f161ab15ed9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:09 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Volume 4b5b0a28-0718-439b-9b18-83061cdee299: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4b5b0a28-0718-439b-9b18-83061cdee299', 'volume_size': 2, 'source_volid': 'f571fe5a-e963-442e-b590-3972a9f1ae63', 'source_volstatus': 'available'}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Created reservations ['d2b6fe54-99c8-4d18-b96d-a09e03896e65', 'ab8a7a82-72b4-4f77-bd6c-184a23662c6f', '587f719c-6724-4f7a-9082-c2e2007f090a', 'd38e1bdf-c621-47f1-9089-3d6319bdf9e9'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:09 devstack sudo[101421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:09 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:10 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfcc9876-0771-4ec6-98f0-fd70c383621d 1073741824" returned: 0 in 0.496s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfcc9876-0771-4ec6-98f0-fd70c383621d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:10 devstack sudo[101425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfcc9876-0771-4ec6-98f0-fd70c383621d
Jul 14 18:02:10 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:10 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.279s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Deleted volume successfully.
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-383befa2-f1c5-4cb6-9e77-612c958410c9 tempest-ProjectReaderTests-434991675 None] Lock "cinder-868b3b76-9dfc-42d7-a48a-7a36e980c16c-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:10 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfcc9876-0771-4ec6-98f0-fd70c383621d" returned: 0 in 0.274s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.579s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:10 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Cloning volume f571fe5a-e963-442e-b590-3972a9f1ae63 to volume 4b5b0a28-0718-439b-9b18-83061cdee299
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41604dd-1851-49b5-beb2-5854b36653c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfcc9876-0771-4ec6-98f0-fd70c383621d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3479d2d-7a08-4f9a-8e78-d40df215c115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Creating offline snapshot 97bb2a1e-4b98-415b-ba30-1069c25c4b1b of volume f571fe5a-e963-442e-b590-3972a9f1ae63 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:02:10 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Volume volume-cfcc9876-0771-4ec6-98f0-fd70c383621d (cfcc9876-0771-4ec6-98f0-fd70c383621d): created successfully
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3479d2d-7a08-4f9a-8e78-d40df215c115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Flow 'volume_create_manager' (c4746f66-54fe-4549-9b90-b5c00b1c33a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[68594862-1acc-4363-9f4d-c753a232aa0f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-63cf5601-3711-4029-bda6-908ebd9ed99e tempest-VolumesListTestJSON-299551481 None] Created volume successfully.
Jul 14 18:02:10 devstack sudo[101428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63
Jul 14 18:02:10 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:10 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:10 devstack sudo[101433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b 1G
Jul 14 18:02:10 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:11 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b 1G" returned: 0 in 0.410s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f571fe5a-e963-442e-b590-3972a9f1ae63 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:11 devstack sudo[101438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f571fe5a-e963-442e-b590-3972a9f1ae63 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b
Jul 14 18:02:11 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:11 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f571fe5a-e963-442e-b590-3972a9f1ae63 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:11 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b is being set with open permissions: ugo+rw
Jul 14 18:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:11 devstack sudo[101444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b
Jul 14 18:02:11 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:11 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b" returned: 0 in 0.279s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:11 devstack sudo[101447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.info
Jul 14 18:02:11 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Flow 'volume_create_manager' (56dbd734-cefa-43fc-8f26-7137ae00b9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa762da-66f8-4265-bad9-183cd4a4984b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:12 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa762da-66f8-4265-bad9-183cd4a4984b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1211592560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319c6b1e-bc07-4b62-b36b-ea8fb4ede943,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1acc7d0c1f5342a2bf114e4a43b1e0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:12Z,use_quota=True,user_id='83bf8488b64e4812a45ab2cfa3febb17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20247e8c-da8d-46f4-a45d-726bb886fc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20247e8c-da8d-46f4-a45d-726bb886fc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fef5b6-9a0a-41db-9d85-94204223df3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fef5b6-9a0a-41db-9d85-94204223df3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319c6b1e-bc07-4b62-b36b-ea8fb4ede943', 'volume_name': 'volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c5c49b-bffe-408b-ab61-ebbd939901b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c5c49b-bffe-408b-ab61-ebbd939901b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b7e0cb-f633-4aff-af46-7c52bee95fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:12 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Volume 319c6b1e-bc07-4b62-b36b-ea8fb4ede943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943', 'volume_size': 1}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.info" returned: 0 in 0.303s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:12 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.info is being set with open permissions: ugo+rw
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:12 devstack sudo[101450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.info
Jul 14 18:02:12 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:12 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.info" returned: 0 in 0.225s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Acquiring lock "cinder-quobyte-4b5b0a28-0718-439b-9b18-83061cdee299" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Lock "cinder-quobyte-4b5b0a28-0718-439b-9b18-83061cdee299" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] snapshot: 97bb2a1e-4b98-415b-ba30-1069c25c4b1b, volume: 4b5b0a28-0718-439b-9b18-83061cdee299,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5278a0-7c4c-4ecf-9739-bcf0b917d237]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:12 devstack sudo[101453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b
Jul 14 18:02:12 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:12 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f571fe5a-e963-442e-b590-3972a9f1ae63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f7595f-40cb-42da-9c85-b0a6d673051d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:12 devstack sudo[101458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63
Jul 14 18:02:12 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:13 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:13 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Path /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 18:02:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:13 devstack sudo[101463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299
Jul 14 18:02:13 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:17 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299" returned: 0 in 3.934s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7c22fd-d67a-44bf-a4f2-a7ca1acaf5bc]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:17 devstack sudo[101477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63
Jul 14 18:02:17 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:17 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63" returned: 0 in 0.543s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63, size 1024.00 MB, duration 3.94 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:02:17 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Converted 1024.00 MB image at 260.18 MB/s
Jul 14 18:02:17 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299 is being set with open permissions: ugo+rw
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:17 devstack sudo[101483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299
Jul 14 18:02:17 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:17 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299" returned: 0 in 0.227s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Lock "cinder-quobyte-4b5b0a28-0718-439b-9b18-83061cdee299" released by "_copy_volume_from_snapshot" :: held 5.460s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Acquiring lock "cinder-quobyte-97bb2a1e-4b98-415b-ba30-1069c25c4b1b" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Lock "cinder-quobyte-97bb2a1e-4b98-415b-ba30-1069c25c4b1b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Deleting offline snapshot 97bb2a1e-4b98-415b-ba30-1069c25c4b1b of volume f571fe5a-e963-442e-b590-3972a9f1ae63 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] snapshot_file for this snap is: volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdef21f0-03fc-4f23-b214-516469d08eeb]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:17 devstack sudo[101486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b
Jul 14 18:02:17 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:18 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b" returned: 0 in 0.344s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f571fe5a-e963-442e-b590-3972a9f1ae63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:02:18 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[88297b61-5d6c-4b0c-ad1c-0c551f5a7809]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:18 devstack sudo[101491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63
Jul 14 18:02:18 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:18 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63" returned: 0 in 0.335s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:18 devstack sudo[101496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b
Jul 14 18:02:18 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:18 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:18 devstack sudo[101501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b
Jul 14 18:02:18 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:19 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63.97bb2a1e-4b98-415b-ba30-1069c25c4b1b" returned: 0 in 0.255s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Lock "cinder-quobyte-97bb2a1e-4b98-415b-ba30-1069c25c4b1b" released by "_delete_snapshot" :: held 1.322s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.876s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.101s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1211592560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319c6b1e-bc07-4b62-b36b-ea8fb4ede943,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1acc7d0c1f5342a2bf114e4a43b1e0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:12Z,use_quota=True,user_id='83bf8488b64e4812a45ab2cfa3febb17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Creating volume 319c6b1e-bc07-4b62-b36b-ea8fb4ede943 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:02:19 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:19 devstack sudo[101504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943 1073741824
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d72215-f359-4f7c-9040-f161ab15ed9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5b0a28-0718-439b-9b18-83061cdee299', 'volume_size': 2, 'source_volid': 'f571fe5a-e963-442e-b590-3972a9f1ae63', 'source_volstatus': 'available'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:19 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d63ff74-cf99-4203-8a4c-7a230a88a2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Volume volume-4b5b0a28-0718-439b-9b18-83061cdee299 (4b5b0a28-0718-439b-9b18-83061cdee299): created successfully
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d63ff74-cf99-4203-8a4c-7a230a88a2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Flow 'volume_create_manager' (acf8d09f-e313-4a7f-947d-44075d3e4e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9a7ab2ef-1500-4c77-91d7-6af39f2b421d tempest-VolumesCloneTest-1734230911 None] Created volume successfully.
Jul 14 18:02:19 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943 1073741824" returned: 0 in 0.416s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:19 devstack sudo[101511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943
Jul 14 18:02:19 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:19 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943" returned: 0 in 0.234s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b7e0cb-f633-4aff-af46-7c52bee95fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12421afa-cdb3-4fc3-a6ae-128e22467dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Volume volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943 (319c6b1e-bc07-4b62-b36b-ea8fb4ede943): created successfully
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12421afa-cdb3-4fc3-a6ae-128e22467dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Flow 'volume_create_manager' (56dbd734-cefa-43fc-8f26-7137ae00b9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bc30a72d-a409-4cf5-a983-0e132219ff37 tempest-VolumesListTestJSON-299551481 None] Created volume successfully.
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Acquiring lock "cinder-4b5b0a28-0718-439b-9b18-83061cdee299-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Lock "cinder-4b5b0a28-0718-439b-9b18-83061cdee299-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Acquiring lock "cinder-quobyte-4b5b0a28-0718-439b-9b18-83061cdee299" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Lock "cinder-quobyte-4b5b0a28-0718-439b-9b18-83061cdee299" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f68719-7a7d-404e-a6c7-c34a229a224d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:20 devstack sudo[101514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299
Jul 14 18:02:20 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:20 devstack sudo[101516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:20 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:20 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299" returned: 0 in 0.408s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:21 devstack sudo[101521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299
Jul 14 18:02:21 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:21 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Flow 'volume_create_manager' (bd45f304-a061-4405-88a3-0b6537eb21d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3a7fd5-3ae0-471d-ba0a-b998095547d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3a7fd5-3ae0-471d-ba0a-b998095547d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1111912556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fafb146d-9b44-4923-9810-ced397d07a54,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1acc7d0c1f5342a2bf114e4a43b1e0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:21Z,use_quota=True,user_id='83bf8488b64e4812a45ab2cfa3febb17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bff924-3fd9-4615-abab-7ad71e8c512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bff924-3fd9-4615-abab-7ad71e8c512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df397e1-35b7-45f8-81aa-6232f6ac3978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:21 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df397e1-35b7-45f8-81aa-6232f6ac3978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fafb146d-9b44-4923-9810-ced397d07a54', 'volume_name': 'volume-fafb146d-9b44-4923-9810-ced397d07a54', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0d1583-80ec-49ba-b4c2-b84085877fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0d1583-80ec-49ba-b4c2-b84085877fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7526981-7ba1-4164-9e66-1ffeea47cc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Volume fafb146d-9b44-4923-9810-ced397d07a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fafb146d-9b44-4923-9810-ced397d07a54', 'volume_size': 1}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1111912556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fafb146d-9b44-4923-9810-ced397d07a54,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1acc7d0c1f5342a2bf114e4a43b1e0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:21Z,use_quota=True,user_id='83bf8488b64e4812a45ab2cfa3febb17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Creating volume fafb146d-9b44-4923-9810-ced397d07a54 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:02:21 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fafb146d-9b44-4923-9810-ced397d07a54 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4b5b0a28-0718-439b-9b18-83061cdee299" returned: 0 in 0.308s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:21 devstack sudo[101525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fafb146d-9b44-4923-9810-ced397d07a54 1073741824
Jul 14 18:02:21 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Lock "cinder-quobyte-4b5b0a28-0718-439b-9b18-83061cdee299" released by "delete_volume" :: held 0.765s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Created reservations ['45f9289f-8f57-4e57-93c1-32215faef6b8', '60ddfb70-1f92-4708-9e49-076260fd6f31', '94a72f93-0389-4ec5-b43c-d429c14729fa', '90913213-2b7d-4d69-ae72-860629530de7'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:21 devstack sudo[101527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:21 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:21 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.252s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Deleted volume successfully.
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ed3399f1-55fa-44ba-91fa-b63d63472f9c tempest-VolumesCloneTest-1734230911 None] Lock "cinder-4b5b0a28-0718-439b-9b18-83061cdee299-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:21 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Acquiring lock "cinder-f571fe5a-e963-442e-b590-3972a9f1ae63-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fafb146d-9b44-4923-9810-ced397d07a54 1073741824" returned: 0 in 0.471s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Lock "cinder-f571fe5a-e963-442e-b590-3972a9f1ae63-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fafb146d-9b44-4923-9810-ced397d07a54 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:21 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fafb146d-9b44-4923-9810-ced397d07a54
Jul 14 18:02:21 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Acquiring lock "cinder-quobyte-f571fe5a-e963-442e-b590-3972a9f1ae63" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Lock "cinder-quobyte-f571fe5a-e963-442e-b590-3972a9f1ae63" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0341fa-194c-4127-84a3-00f6a135c1b6]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:22 devstack sudo[101537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63
Jul 14 18:02:22 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:22 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fafb146d-9b44-4923-9810-ced397d07a54" returned: 0 in 0.253s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7526981-7ba1-4164-9e66-1ffeea47cc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fafb146d-9b44-4923-9810-ced397d07a54', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa608746-2674-42c7-bcb7-839998e58620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Volume volume-fafb146d-9b44-4923-9810-ced397d07a54 (fafb146d-9b44-4923-9810-ced397d07a54): created successfully
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa608746-2674-42c7-bcb7-839998e58620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Flow 'volume_create_manager' (bd45f304-a061-4405-88a3-0b6537eb21d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1b156f05-1972-4b99-9e40-df8fc8277c99 tempest-VolumesListTestJSON-299551481 None] Created volume successfully.
Jul 14 18:02:22 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63" returned: 0 in 0.386s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:22 devstack sudo[101543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63
Jul 14 18:02:22 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:22 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-f571fe5a-e963-442e-b590-3972a9f1ae63" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Lock "cinder-quobyte-f571fe5a-e963-442e-b590-3972a9f1ae63" released by "delete_volume" :: held 0.674s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Created reservations ['e4fc8b6a-66a2-4064-8f2b-cba90e9a3f3a', 'cdade488-f316-466e-8ac0-cdb93509f909', '8f5096d5-9397-442e-808d-119c349f2ddb', '2004108f-51e3-4550-bdcb-274013804ff3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:22 devstack sudo[101546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:22 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:22 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Deleted volume successfully.
Jul 14 18:02:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-1a80e8f9-5e49-4cd1-9a2f-ab2a9007bb96 tempest-VolumesCloneTest-1734230911 None] Lock "cinder-f571fe5a-e963-442e-b590-3972a9f1ae63-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "cinder-fafb146d-9b44-4923-9810-ced397d07a54-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Lock "cinder-fafb146d-9b44-4923-9810-ced397d07a54-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "cinder-quobyte-fafb146d-9b44-4923-9810-ced397d07a54" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Lock "cinder-quobyte-fafb146d-9b44-4923-9810-ced397d07a54" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a16af9d-31db-421d-8a5a-c0dcec1f0f89]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fafb146d-9b44-4923-9810-ced397d07a54 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:25 devstack sudo[101549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fafb146d-9b44-4923-9810-ced397d07a54
Jul 14 18:02:25 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Flow 'volume_create_manager' (1cbef106-9fa1-4faa-8fb9-715d00451ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273e127a-3c69-46a1-b0c7-d8be4a92a690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (273e127a-3c69-46a1-b0c7-d8be4a92a690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1328652429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ea9c01-01d4-4c24-bba8-df76c912929a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db68999dfb084a27a0e2f00395670465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:26Z,use_quota=True,user_id='752bcbbf164d475b8ec973fd2033facd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe23d24-1738-439f-9f57-7c1ed515114e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe23d24-1738-439f-9f57-7c1ed515114e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee77fd0-59cf-4e17-bd34-bc08473601b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee77fd0-59cf-4e17-bd34-bc08473601b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ea9c01-01d4-4c24-bba8-df76c912929a', 'volume_name': 'volume-c7ea9c01-01d4-4c24-bba8-df76c912929a', 'volume_size': 2}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd434e50-4f64-42f4-8d80-fc1fe1d8594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd434e50-4f64-42f4-8d80-fc1fe1d8594f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee18f32-7ec5-4d6f-99a3-9e76f961fa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:25 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Volume c7ea9c01-01d4-4c24-bba8-df76c912929a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ea9c01-01d4-4c24-bba8-df76c912929a', 'volume_size': 2}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1328652429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ea9c01-01d4-4c24-bba8-df76c912929a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db68999dfb084a27a0e2f00395670465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:26Z,use_quota=True,user_id='752bcbbf164d475b8ec973fd2033facd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Creating volume c7ea9c01-01d4-4c24-bba8-df76c912929a {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:02:25 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c7ea9c01-01d4-4c24-bba8-df76c912929a 2147483648 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:25 devstack sudo[101553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c7ea9c01-01d4-4c24-bba8-df76c912929a 2147483648
Jul 14 18:02:25 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:25 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fafb146d-9b44-4923-9810-ced397d07a54" returned: 0 in 0.403s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fafb146d-9b44-4923-9810-ced397d07a54 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:25 devstack sudo[101556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fafb146d-9b44-4923-9810-ced397d07a54
Jul 14 18:02:25 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:26 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-fafb146d-9b44-4923-9810-ced397d07a54" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Lock "cinder-quobyte-fafb146d-9b44-4923-9810-ced397d07a54" released by "delete_volume" :: held 0.711s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Created reservations ['c6664ba4-d74c-4c68-8506-414ce0820a50', '3b4c45a7-7697-4f73-b292-d3324963c7b5', 'd91f57a5-a836-4c18-bf69-d9c99fc8bde6', '72108d43-f207-4b84-8f2d-00434c5a5920'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:26 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c7ea9c01-01d4-4c24-bba8-df76c912929a 2147483648" returned: 0 in 0.500s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c7ea9c01-01d4-4c24-bba8-df76c912929a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:26 devstack sudo[101563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:26 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:26 devstack sudo[101564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c7ea9c01-01d4-4c24-bba8-df76c912929a
Jul 14 18:02:26 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:26 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:26 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c7ea9c01-01d4-4c24-bba8-df76c912929a" returned: 0 in 0.242s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "cinder-319c6b1e-bc07-4b62-b36b-ea8fb4ede943-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Deleted volume successfully.
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee18f32-7ec5-4d6f-99a3-9e76f961fa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ea9c01-01d4-4c24-bba8-df76c912929a', 'volume_size': 2}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3dfcf28-f45b-46f6-92b9-dddaa18f5e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Lock "cinder-319c6b1e-bc07-4b62-b36b-ea8fb4ede943-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Volume volume-c7ea9c01-01d4-4c24-bba8-df76c912929a (c7ea9c01-01d4-4c24-bba8-df76c912929a): created successfully
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3dfcf28-f45b-46f6-92b9-dddaa18f5e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Flow 'volume_create_manager' (1cbef106-9fa1-4faa-8fb9-715d00451ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e599866d-4554-4b7f-9a3c-c9407536f0f7 tempest-VolumesListTestJSON-299551481 None] Lock "cinder-fafb146d-9b44-4923-9810-ced397d07a54-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c2b931de-3e0a-4bed-a897-fce0f329925b tempest-VolumesCloneNegativeTest-1722192834 None] Created volume successfully.
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "cinder-quobyte-319c6b1e-bc07-4b62-b36b-ea8fb4ede943" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Lock "cinder-quobyte-319c6b1e-bc07-4b62-b36b-ea8fb4ede943" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[74069c31-c0e0-4c58-9431-fc2b83d9ec18]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:26 devstack sudo[101569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943
Jul 14 18:02:26 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:27 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943" returned: 0 in 0.356s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:27 devstack sudo[101574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943
Jul 14 18:02:27 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:27 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-319c6b1e-bc07-4b62-b36b-ea8fb4ede943" returned: 0 in 0.238s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Lock "cinder-quobyte-319c6b1e-bc07-4b62-b36b-ea8fb4ede943" released by "delete_volume" :: held 0.627s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Created reservations ['30e9e012-6a4b-4585-8f36-d269e8063b5c', 'a1ba9354-f16a-4f0e-bbfb-e5458c55f5f5', '4f824bea-dc66-4d1e-be7b-38b661fe3367', 'd353e80a-f265-405a-bff1-58d8e1472d97'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:27 devstack sudo[101577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:27 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:27 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.232s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Deleted volume successfully.
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c59dd937-e676-41e0-8b5b-37fda29af6a2 tempest-VolumesListTestJSON-299551481 None] Lock "cinder-319c6b1e-bc07-4b62-b36b-ea8fb4ede943-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "cinder-cfcc9876-0771-4ec6-98f0-fd70c383621d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Lock "cinder-cfcc9876-0771-4ec6-98f0-fd70c383621d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "cinder-quobyte-cfcc9876-0771-4ec6-98f0-fd70c383621d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Lock "cinder-quobyte-cfcc9876-0771-4ec6-98f0-fd70c383621d" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4a6c69-ca2d-4e70-8112-1a24fd53e62a]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfcc9876-0771-4ec6-98f0-fd70c383621d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Acquiring lock "cinder-c7ea9c01-01d4-4c24-bba8-df76c912929a-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Lock "cinder-c7ea9c01-01d4-4c24-bba8-df76c912929a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Acquiring lock "cinder-quobyte-c7ea9c01-01d4-4c24-bba8-df76c912929a" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Lock "cinder-quobyte-c7ea9c01-01d4-4c24-bba8-df76c912929a" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e8e529-96dd-4a5a-8840-d597ee548650]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c7ea9c01-01d4-4c24-bba8-df76c912929a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:28 devstack sudo[101580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfcc9876-0771-4ec6-98f0-fd70c383621d
Jul 14 18:02:28 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:28 devstack sudo[101582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c7ea9c01-01d4-4c24-bba8-df76c912929a
Jul 14 18:02:28 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:28 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfcc9876-0771-4ec6-98f0-fd70c383621d" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfcc9876-0771-4ec6-98f0-fd70c383621d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:28 devstack sudo[101587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfcc9876-0771-4ec6-98f0-fd70c383621d
Jul 14 18:02:28 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:28 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c7ea9c01-01d4-4c24-bba8-df76c912929a" returned: 0 in 0.351s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c7ea9c01-01d4-4c24-bba8-df76c912929a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:28 devstack sudo[101592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c7ea9c01-01d4-4c24-bba8-df76c912929a
Jul 14 18:02:28 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:28 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfcc9876-0771-4ec6-98f0-fd70c383621d" returned: 0 in 0.257s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Lock "cinder-quobyte-cfcc9876-0771-4ec6-98f0-fd70c383621d" released by "delete_volume" :: held 0.674s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Created reservations ['54232a8f-8cb1-4ef4-8e35-137e4d65617e', '0d90c8c6-7592-46ef-90bb-440e7c465312', '6b859693-2542-46be-adec-1c42e8be322d', '5af165da-3544-4457-b9b2-924116ae960b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:28 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c7ea9c01-01d4-4c24-bba8-df76c912929a" returned: 0 in 0.247s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Lock "cinder-quobyte-c7ea9c01-01d4-4c24-bba8-df76c912929a" released by "delete_volume" :: held 0.635s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:28 devstack sudo[101596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:28 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Created reservations ['5a9fe6da-ba00-4e91-b09e-d844d8844074', 'a281a8df-5250-4c9b-9f8b-45c02a7ec88c', '2b0c3a48-6447-4ffb-aa3b-8fbb68ebdb9c', 'ffc752a2-8e74-4a02-83a6-3b1d2c3f54ff'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:28 devstack sudo[101598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:28 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:28 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.249s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:29 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Deleted volume successfully.
Jul 14 18:02:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5b59a277-803e-407d-9797-672c4cb993f1 tempest-VolumesListTestJSON-299551481 None] Lock "cinder-cfcc9876-0771-4ec6-98f0-fd70c383621d-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:29 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.293s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:29 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Deleted volume successfully.
Jul 14 18:02:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f82ac25a-1614-4559-a05e-10dd56f40788 tempest-VolumesCloneNegativeTest-1722192834 None] Lock "cinder-c7ea9c01-01d4-4c24-bba8-df76c912929a-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Flow 'volume_create_manager' (3d5c3a39-2ccf-439c-acd6-cd896324f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81d14f2-8949-4fd5-818d-719267d0e74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81d14f2-8949-4fd5-818d-719267d0e74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2018467924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbb8fd4-1489-426c-80c4-2aa25a9ea03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef07b62495614d99a66221823ef989f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:32Z,use_quota=True,user_id='736f554446494d91ade87d4f2cc26e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3aeccc-4e99-4839-8bcb-e747e43c13ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3aeccc-4e99-4839-8bcb-e747e43c13ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3ea110-a9c5-4dbb-bbe1-cd7e46832756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3ea110-a9c5-4dbb-bbe1-cd7e46832756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dbb8fd4-1489-426c-80c4-2aa25a9ea03c', 'volume_name': 'volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7855fc-bc9a-41db-9aed-beba01d7d62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7855fc-bc9a-41db-9aed-beba01d7d62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee213879-2d71-460f-865e-db7ba4fe205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:32 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Volume 2dbb8fd4-1489-426c-80c4-2aa25a9ea03c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c', 'volume_size': 1}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2018467924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbb8fd4-1489-426c-80c4-2aa25a9ea03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef07b62495614d99a66221823ef989f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:32Z,use_quota=True,user_id='736f554446494d91ade87d4f2cc26e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Creating volume 2dbb8fd4-1489-426c-80c4-2aa25a9ea03c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:02:32 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:32 devstack sudo[101603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c 1073741824
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:02:32 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Flow 'volume_create_manager' (1549c683-006f-416c-9c9d-f1f0022ddcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da0b2fd-27e5-461a-8378-50f007c8a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da0b2fd-27e5-461a-8378-50f007c8a56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1134075604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64948cd-525d-4e97-9441-9a9a953077c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c628b8af16614dd1a5d602ee4a4ed2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:32Z,use_quota=True,user_id='2bfabe9c985145fc9734086a5ab7ce26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa792737-c549-4929-9d92-f7b74a741b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa792737-c549-4929-9d92-f7b74a741b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd49bf3-aaac-4cfd-a519-93f13277e317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd49bf3-aaac-4cfd-a519-93f13277e317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64948cd-525d-4e97-9441-9a9a953077c7', 'volume_name': 'volume-b64948cd-525d-4e97-9441-9a9a953077c7', 'volume_size': 2}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc9be2e-d3b7-4277-a5af-676ec396fac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc9be2e-d3b7-4277-a5af-676ec396fac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f0c49d-ecef-4bde-b3fe-716d50fd1caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:32 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Volume b64948cd-525d-4e97-9441-9a9a953077c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64948cd-525d-4e97-9441-9a9a953077c7', 'volume_size': 2}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:32 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c 1073741824" returned: 0 in 0.440s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:32 devstack sudo[101609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c
Jul 14 18:02:32 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:33 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c" returned: 0 in 0.246s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.613s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1134075604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64948cd-525d-4e97-9441-9a9a953077c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c628b8af16614dd1a5d602ee4a4ed2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:32Z,use_quota=True,user_id='2bfabe9c985145fc9734086a5ab7ce26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Creating volume b64948cd-525d-4e97-9441-9a9a953077c7 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:02:33 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7 2147483648 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee213879-2d71-460f-865e-db7ba4fe205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:33 devstack sudo[101612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7 2147483648
Jul 14 18:02:33 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348601d5-f65a-4bd3-bc77-2b93f889b709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Volume volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c (2dbb8fd4-1489-426c-80c4-2aa25a9ea03c): created successfully
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348601d5-f65a-4bd3-bc77-2b93f889b709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Flow 'volume_create_manager' (3d5c3a39-2ccf-439c-acd6-cd896324f47d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1426e665-4af6-4bfc-a0f4-42f15d3219cc tempest-VolumesNegativeTest-398516395 None] Created volume successfully.
Jul 14 18:02:33 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7 2147483648" returned: 0 in 0.464s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:33 devstack sudo[101617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7
Jul 14 18:02:33 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:33 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7" returned: 0 in 0.267s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f0c49d-ecef-4bde-b3fe-716d50fd1caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64948cd-525d-4e97-9441-9a9a953077c7', 'volume_size': 2}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2162e690-72e2-4e50-a3f3-1c7d43e05204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Volume volume-b64948cd-525d-4e97-9441-9a9a953077c7 (b64948cd-525d-4e97-9441-9a9a953077c7): created successfully
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2162e690-72e2-4e50-a3f3-1c7d43e05204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Flow 'volume_create_manager' (1549c683-006f-416c-9c9d-f1f0022ddcf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7c0046d8-4799-49fa-99f6-4b9e6c079bba tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Created volume successfully.
Jul 14 18:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Creating offline snapshot 4372f79e-567d-4832-aa19-d7149bb50f54 of volume b64948cd-525d-4e97-9441-9a9a953077c7 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:02:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f7f3b5-8271-4be0-b9c2-605eb727ff78]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:34 devstack sudo[101620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7
Jul 14 18:02:34 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:34 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7" returned: 0 in 0.423s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54 2G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:35 devstack sudo[101628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54 2G
Jul 14 18:02:35 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:35 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54 2G" returned: 0 in 0.423s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b64948cd-525d-4e97-9441-9a9a953077c7 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:35 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b64948cd-525d-4e97-9441-9a9a953077c7 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54
Jul 14 18:02:35 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:35 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b64948cd-525d-4e97-9441-9a9a953077c7 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54" returned: 0 in 0.295s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:35 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54 is being set with open permissions: ugo+rw
Jul 14 18:02:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:35 devstack sudo[101639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54
Jul 14 18:02:35 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:35 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54" returned: 0 in 0.278s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:36 devstack sudo[101643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.info
Jul 14 18:02:36 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:36 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.info" returned: 0 in 0.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:36 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.info is being set with open permissions: ugo+rw
Jul 14 18:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:36 devstack sudo[101652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.info
Jul 14 18:02:36 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:36 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.info" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c920cade-b808-408a-bfb6-0be2aa2764f9 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Create snapshot completed successfully
Jul 14 18:02:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Acquiring lock "cinder-4372f79e-567d-4832-aa19-d7149bb50f54-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "cinder-4372f79e-567d-4832-aa19-d7149bb50f54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Acquiring lock "cinder-quobyte-b64948cd-525d-4e97-9441-9a9a953077c7" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "cinder-quobyte-b64948cd-525d-4e97-9441-9a9a953077c7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Acquiring lock "cinder-quobyte-4372f79e-567d-4832-aa19-d7149bb50f54" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "cinder-quobyte-4372f79e-567d-4832-aa19-d7149bb50f54" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Deleting offline snapshot 4372f79e-567d-4832-aa19-d7149bb50f54 of volume b64948cd-525d-4e97-9441-9a9a953077c7 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:02:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] snapshot_file for this snap is: volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:02:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fc5c1a-26e9-4546-b73f-374f4c2932b9]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:37 devstack sudo[101663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54
Jul 14 18:02:37 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:38 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54" returned: 0 in 0.382s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b64948cd-525d-4e97-9441-9a9a953077c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:02:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2993c0c-ae85-46a6-bc51-cb9e9e8e3241]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:38 devstack sudo[101669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7
Jul 14 18:02:38 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:38 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7" returned: 0 in 0.468s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:38 devstack sudo[101685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54
Jul 14 18:02:38 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:39 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54" returned: 0 in 0.662s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:39 devstack sudo[101772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54
Jul 14 18:02:39 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:39 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7.4372f79e-567d-4832-aa19-d7149bb50f54" returned: 0 in 0.567s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "cinder-quobyte-4372f79e-567d-4832-aa19-d7149bb50f54" released by "_delete_snapshot" :: held 2.194s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "cinder-quobyte-b64948cd-525d-4e97-9441-9a9a953077c7" released by "delete_snapshot" :: held 2.226s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:40 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Created reservations ['f04966c3-7145-4acd-be80-b9fccf466b2f', '78ea007b-7120-4b87-9229-9746fbeb7ca6', '29dca6b5-1e46-44ad-8f29-539db85dfd71', '5de9242e-91ca-4e6b-a3fa-d7ba1e48ff39'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:40 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Delete snapshot completed successfully.
Jul 14 18:02:40 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-50e6df3d-3987-44d9-817f-9273df7337e7 tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "cinder-4372f79e-567d-4832-aa19-d7149bb50f54-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Acquiring lock "cinder-b64948cd-525d-4e97-9441-9a9a953077c7-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "cinder-b64948cd-525d-4e97-9441-9a9a953077c7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Acquiring lock "cinder-quobyte-b64948cd-525d-4e97-9441-9a9a953077c7" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "cinder-quobyte-b64948cd-525d-4e97-9441-9a9a953077c7" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:41 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a005dca-8f40-43a4-b64b-4f92ceecc041]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:41 devstack sudo[101788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7
Jul 14 18:02:41 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:41 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7" returned: 0 in 0.394s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:41 devstack sudo[101793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7
Jul 14 18:02:41 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:41 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b64948cd-525d-4e97-9441-9a9a953077c7" returned: 0 in 0.298s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "cinder-quobyte-b64948cd-525d-4e97-9441-9a9a953077c7" released by "delete_volume" :: held 0.762s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:41 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Created reservations ['57c9a4a8-8c45-478b-bd69-54f5aa992a9e', '41714a9d-4eb7-46b8-9f3d-acaf03460419', '9bcc28af-428e-40c3-ba6e-ae60fff9e4ea', 'be57b05e-e2da-4228-a2df-bdbbfe6e784d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:42 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:42 devstack sudo[101809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:42 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:42 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.347s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:42 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Deleted volume successfully.
Jul 14 18:02:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a8b1d684-5995-4483-a8e8-75b16df36a8a tempest-VolumesSnapshotNegativeTestJSON-70496661 None] Lock "cinder-b64948cd-525d-4e97-9441-9a9a953077c7-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Acquiring lock "cinder-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Lock "cinder-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:50 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=115,cinder:UPDATE=172,cinder:INSERT=38,cinder:DELETE=15 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:02:50 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=158,cinder:SELECT=121,cinder:INSERT=51,cinder:DELETE=14 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:02:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Acquiring lock "cinder-quobyte-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:02:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Lock "cinder-quobyte-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:02:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada4231e-e693-44f8-97d3-2d76fb52975b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:50 devstack sudo[101823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c
Jul 14 18:02:50 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:51 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c" returned: 0 in 0.384s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:51 devstack sudo[101828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c
Jul 14 18:02:51 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:51 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Lock "cinder-quobyte-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c" released by "delete_volume" :: held 0.697s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Created reservations ['ab128049-ce9e-4c73-80d5-44b513c92b31', 'd1d41293-0e24-4afe-b510-ed0f093ff7f7', '38fab78e-3fc8-40d2-ac30-826b67139e0b', '8b36a04e-dffb-4e9c-bb35-e331b417b495'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:51 devstack sudo[101833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:02:51 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:51 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:02:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Deleted volume successfully.
Jul 14 18:02:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-455a0f93-01f0-4ae0-abe4-b8c121636c5f tempest-VolumesNegativeTest-398516395 None] Lock "cinder-2dbb8fd4-1489-426c-80c4-2aa25a9ea03c-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:02:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Flow 'volume_create_manager' (b4ec87fb-1a30-44e6-bd83-a985a5ce0782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2371122b-67a1-436d-ad53-cb5c238ce0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2371122b-67a1-436d-ad53-cb5c238ce0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21a54e6-b92f-4dc7-9cb6-3452c7266bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d39fcf64ff64698b74b146b578fbf28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:58Z,use_quota=True,user_id='00f38358b2b04e5f910266b18dad586b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e210186b-dff4-4f4e-ab9c-9effafa8dde0),volume_type_id=e210186b-dff4-4f4e-ab9c-9effafa8dde0)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5550ce-e228-4aa3-9d8e-149caccb9b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5550ce-e228-4aa3-9d8e-149caccb9b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ed9991-f5b8-480b-9939-488a49a98b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ed9991-f5b8-480b-9939-488a49a98b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c21a54e6-b92f-4dc7-9cb6-3452c7266bd7', 'volume_name': 'volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7', 'volume_size': 1, 'image_id': '1b9f09e1-e8ed-4262-b7f3-711778befb68', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b9f09e1-e8ed-4262-b7f3-711778befb68', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0e6e1307b84a5a86c1ee005822220757', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3d39fcf64ff64698b74b146b578fbf28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '844cb7a3003986c7d473253f166404d07b90e7c6ea256205deded0828d4bf4b01d0f3e31e79640f59114c8ead1ab7d877cc61946bf738e87a20a8139398fac01', 'id': '1b9f09e1-e8ed-4262-b7f3-711778befb68', 'created_at': datetime.datetime(2026, 7, 14, 16, 2, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 16, 2, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b9f09e1-e8ed-4262-b7f3-711778befb68/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2bfec5a00>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03430427-092e-4705-b853-5b5082a6b508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03430427-092e-4705-b853-5b5082a6b508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e61aec-53e2-4079-bd43-deb742730cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:02:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Volume c21a54e6-b92f-4dc7-9cb6-3452c7266bd7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7', 'volume_size': 1, 'image_id': '1b9f09e1-e8ed-4262-b7f3-711778befb68', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b9f09e1-e8ed-4262-b7f3-711778befb68', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0e6e1307b84a5a86c1ee005822220757', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3d39fcf64ff64698b74b146b578fbf28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '844cb7a3003986c7d473253f166404d07b90e7c6ea256205deded0828d4bf4b01d0f3e31e79640f59114c8ead1ab7d877cc61946bf738e87a20a8139398fac01', 'id': '1b9f09e1-e8ed-4262-b7f3-711778befb68', 'created_at': datetime.datetime(2026, 7, 14, 16, 2, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 16, 2, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b9f09e1-e8ed-4262-b7f3-711778befb68/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2bfec5a00>}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Trying to clone c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 from image 1b9f09e1-e8ed-4262-b7f3-711778befb68 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b9f09e1-e8ed-4262-b7f3-711778befb68', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 18:02:58 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Image download 0.00 MB at 0.00 MB/s
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b95cc8d-3a28-4291-9e1b-ca9c72b2a48d]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:58 devstack sudo[101842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD
Jul 14 18:02:58 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:58 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:58 devstack sudo[101846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD
Jul 14 18:02:58 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:59 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:02:59 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Temporary image 1b9f09e1-e8ed-4262-b7f3-711778befb68 is fetched for user 00f38358b2b04e5f910266b18dad586b. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 18:02:59 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e954e4d7-3d94-43fb-8b41-e43aff52241f]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:59 devstack sudo[101851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD
Jul 14 18:02:59 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:02:59 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root
Jul 14 18:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:02:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:02:59 devstack sudo[101856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD
Jul 14 18:02:59 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:00 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21a54e6-b92f-4dc7-9cb6-3452c7266bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d39fcf64ff64698b74b146b578fbf28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:02:58Z,use_quota=True,user_id='00f38358b2b04e5f910266b18dad586b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e210186b-dff4-4f4e-ab9c-9effafa8dde0),volume_type_id=e210186b-dff4-4f4e-ab9c-9effafa8dde0)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Creating volume c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:03:00 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:00 devstack sudo[101861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 1073741824
Jul 14 18:03:00 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:00 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 1073741824" returned: 0 in 0.423s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:00 devstack sudo[101866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7
Jul 14 18:03:00 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:00 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7" returned: 0 in 0.252s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Attempting download of 1b9f09e1-e8ed-4262-b7f3-711778befb68 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b9f09e1-e8ed-4262-b7f3-711778befb68', 'metadata': {}}])) to volume c21a54e6-b92f-4dc7-9cb6-3452c7266bd7. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24c6c0c-0b21-4a39-9e9a-86803a012e74]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:03:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b9f09e1-e8ed-4262-b7f3-711778befb68_xj9c3sqx {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:00 devstack sudo[101869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b9f09e1-e8ed-4262-b7f3-711778befb68_xj9c3sqx
Jul 14 18:03:00 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:01 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b9f09e1-e8ed-4262-b7f3-711778befb68_xj9c3sqx" returned: 0 in 0.347s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b9f09e1-e8ed-4262-b7f3-711778befb68_xj9c3sqx {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:01 devstack sudo[101873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b9f09e1-e8ed-4262-b7f3-711778befb68_xj9c3sqx
Jul 14 18:03:01 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:01 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b9f09e1-e8ed-4262-b7f3-711778befb68_xj9c3sqx" returned: 1 in 0.417s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b9f09e1-e8ed-4262-b7f3-711778befb68_xj9c3sqx' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:03:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f8735a-b340-4527-8fdb-3f02d14ef418]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:01 devstack sudo[101877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD
Jul 14 18:03:01 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:01 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:02 devstack sudo[101881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD
Jul 14 18:03:02 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:02 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:03:02 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] 1b9f09e1-e8ed-4262-b7f3-711778befb68 was raw, converting to raw {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 18:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:02 devstack sudo[101886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7
Jul 14 18:03:02 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:02 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:02 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b9f09e1-e8ed-4262-b7f3-711778befb68_hg70w2uudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:03:02 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Converted 0.00 MB image at 0.00 MB/s
Jul 14 18:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:02 devstack sudo[101891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 1G
Jul 14 18:03:02 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:02 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 1G" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf8ea1a-2dd5-478b-9f44-f331524d73ba]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:03:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:03 devstack sudo[101896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7
Jul 14 18:03:03 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:03 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7" returned: 0 in 0.390s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:03 devstack sudo[101900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7
Jul 14 18:03:03 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:03 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7" returned: 1 in 0.398s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Downloaded image 1b9f09e1-e8ed-4262-b7f3-711778befb68 ((None, [{'url': 'file:///opt/stack/data/glance/images/1b9f09e1-e8ed-4262-b7f3-711778befb68', 'metadata': {}}])) to volume c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Temporary image 1b9f09e1-e8ed-4262-b7f3-711778befb68 for user 00f38358b2b04e5f910266b18dad586b is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Marking volume c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Copying metadata from image 1b9f09e1-e8ed-4262-b7f3-711778befb68 to c21a54e6-b92f-4dc7-9cb6-3452c7266bd7. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Creating volume glance metadata for volume c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 backed by image 1b9f09e1-e8ed-4262-b7f3-711778befb68 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1b9f09e1-e8ed-4262-b7f3-711778befb68', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0e6e1307b84a5a86c1ee005822220757', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e61aec-53e2-4079-bd43-deb742730cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7', 'volume_size': 1, 'image_id': '1b9f09e1-e8ed-4262-b7f3-711778befb68', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b9f09e1-e8ed-4262-b7f3-711778befb68', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0e6e1307b84a5a86c1ee005822220757', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3d39fcf64ff64698b74b146b578fbf28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '844cb7a3003986c7d473253f166404d07b90e7c6ea256205deded0828d4bf4b01d0f3e31e79640f59114c8ead1ab7d877cc61946bf738e87a20a8139398fac01', 'id': '1b9f09e1-e8ed-4262-b7f3-711778befb68', 'created_at': datetime.datetime(2026, 7, 14, 16, 2, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 16, 2, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b9f09e1-e8ed-4262-b7f3-711778befb68/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2bfec5a00>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dceea9-a5bc-41de-b00f-d1397030b87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Volume volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 (c21a54e6-b92f-4dc7-9cb6-3452c7266bd7): created successfully
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dceea9-a5bc-41de-b00f-d1397030b87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Flow 'volume_create_manager' (b4ec87fb-1a30-44e6-bd83-a985a5ce0782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c1ee0053-bc33-4345-88d2-3e45c9e44b04 tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Created volume successfully.
Jul 14 18:03:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Acquiring lock "cinder-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Lock "cinder-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Acquiring lock "cinder-quobyte-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Lock "cinder-quobyte-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b4200f-84b8-4092-8a9c-65ae373c7de3]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:04 devstack sudo[101905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7
Jul 14 18:03:04 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:04 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7" returned: 0 in 0.379s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:04 devstack sudo[101909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7
Jul 14 18:03:04 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:05 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7" returned: 1 in 0.365s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:05 devstack sudo[101914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7
Jul 14 18:03:05 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:05 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7" returned: 0 in 0.251s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Lock "cinder-quobyte-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7" released by "delete_volume" :: held 1.077s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:05 devstack cinder-volume[87401]: WARNING cinder.quota [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 14 18:03:05 devstack cinder-volume[87401]: WARNING cinder.quota [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Created reservations ['f72e3c6c-f2aa-4b6f-9999-381440600674', 'a56f893d-5c05-46c4-b019-768305da2513', '0478753d-092a-4b3c-b7b3-1cef9d715387', 'ba835f10-aacb-4b29-bc85-407bee8be04a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:05 devstack sudo[101918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:03:05 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:05 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.248s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:03:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Deleted volume successfully.
Jul 14 18:03:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-41d0841e-9839-41ee-892e-6334d3b3192c tempest-VolumeAndVolumeTypeFromImageTest-1447009368 None] Lock "cinder-c21a54e6-b92f-4dc7-9cb6-3452c7266bd7-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Flow 'volume_create_manager' (f8bfca9b-fb36-4b1c-889d-0cf560428356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249711b1-8c32-44d1-b558-179feb7d224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249711b1-8c32-44d1-b558-179feb7d224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1526425325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba35704-a9c0-43a4-8d75-b6e6303b4f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee604c7ca4d54db39df90479d54a1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:11Z,use_quota=True,user_id='71ae896ebac743ed9821b3c49dab4ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4b40ae-a3a7-450d-814a-f73001f8de18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4b40ae-a3a7-450d-814a-f73001f8de18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a311ce-fd52-45ee-9002-6a26dcfb38f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a311ce-fd52-45ee-9002-6a26dcfb38f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ba35704-a9c0-43a4-8d75-b6e6303b4f62', 'volume_name': 'volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f9632f-8419-4190-bf53-66e1c12e4109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f9632f-8419-4190-bf53-66e1c12e4109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fda98c-bab5-41d0-8127-ea410b10a9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:10 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume 0ba35704-a9c0-43a4-8d75-b6e6303b4f62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62', 'volume_size': 1}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1526425325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba35704-a9c0-43a4-8d75-b6e6303b4f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee604c7ca4d54db39df90479d54a1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:11Z,use_quota=True,user_id='71ae896ebac743ed9821b3c49dab4ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Creating volume 0ba35704-a9c0-43a4-8d75-b6e6303b4f62 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:03:11 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:11 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62 1073741824
Jul 14 18:03:11 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:11 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62 1073741824" returned: 0 in 0.462s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:11 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62
Jul 14 18:03:11 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:11 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fda98c-bab5-41d0-8127-ea410b10a9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9067db-005a-450c-8703-4ed2636af597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:11 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62 (0ba35704-a9c0-43a4-8d75-b6e6303b4f62): created successfully
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9067db-005a-450c-8703-4ed2636af597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Flow 'volume_create_manager' (f8bfca9b-fb36-4b1c-889d-0cf560428356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3be9f2b0-eafb-42b3-be60-94bffd02b503 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Created volume successfully.
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Flow 'volume_create_manager' (74834309-05d3-4345-9d97-1271094d27a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eaff4bb-888e-4233-99eb-811edb71c134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eaff4bb-888e-4233-99eb-811edb71c134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825159540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd6db3b-5e45-40f8-9ef0-7c2402cc886d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee604c7ca4d54db39df90479d54a1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:13Z,use_quota=True,user_id='71ae896ebac743ed9821b3c49dab4ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffd17be-7f71-458a-850b-5153fe23924b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffd17be-7f71-458a-850b-5153fe23924b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d05b62-155d-4e35-b801-6b7fc839d869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d05b62-155d-4e35-b801-6b7fc839d869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd6db3b-5e45-40f8-9ef0-7c2402cc886d', 'volume_name': 'volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f711b6c-9fe6-4b94-8e65-d267f93a0013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f711b6c-9fe6-4b94-8e65-d267f93a0013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb1072a-1fe4-40fe-9205-1649154ca691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:13 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume 7fd6db3b-5e45-40f8-9ef0-7c2402cc886d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d', 'volume_size': 1}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825159540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd6db3b-5e45-40f8-9ef0-7c2402cc886d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee604c7ca4d54db39df90479d54a1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:13Z,use_quota=True,user_id='71ae896ebac743ed9821b3c49dab4ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Creating volume 7fd6db3b-5e45-40f8-9ef0-7c2402cc886d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:03:13 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:03:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:13 devstack sudo[101968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d 1073741824
Jul 14 18:03:13 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Flow 'volume_create_manager' (7d0dca66-5e37-4d06-af43-a1600e2d1eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3443fa5a-dbe4-4200-8818-5f7e9032e91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3443fa5a-dbe4-4200-8818-5f7e9032e91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-809454914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a41054-e171-425f-81aa-a4ec7f9ceeb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee604c7ca4d54db39df90479d54a1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:14Z,use_quota=True,user_id='71ae896ebac743ed9821b3c49dab4ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d894dc-2867-4825-849a-1a88a8a1ab90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d894dc-2867-4825-849a-1a88a8a1ab90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189b2106-916a-4bcd-bf94-d24f4bdae56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189b2106-916a-4bcd-bf94-d24f4bdae56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a41054-e171-425f-81aa-a4ec7f9ceeb5', 'volume_name': 'volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e9dc96e-2240-4620-a0fb-bd923bd0fad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e9dc96e-2240-4620-a0fb-bd923bd0fad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31e92f7-7a10-433a-94cf-a8891381f7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:14 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume 85a41054-e171-425f-81aa-a4ec7f9ceeb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5', 'volume_size': 1}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:14 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d 1073741824" returned: 0 in 0.642s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:14 devstack sudo[101976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d
Jul 14 18:03:14 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Flow 'volume_create_manager' (386ec56b-5676-4677-bdc6-6aac32845235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66cda3b9-a4e9-49c6-93f7-420c4b6e8cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66cda3b9-a4e9-49c6-93f7-420c4b6e8cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-436581292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d358383a-24dd-4607-a873-70a1ad81380d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee604c7ca4d54db39df90479d54a1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:14Z,use_quota=True,user_id='71ae896ebac743ed9821b3c49dab4ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99f7afe-bbab-4d6f-850b-ef86694cbfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99f7afe-bbab-4d6f-850b-ef86694cbfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a40c9f0-cc68-46b3-9efe-e90f2260f134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a40c9f0-cc68-46b3-9efe-e90f2260f134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd358383a-24dd-4607-a873-70a1ad81380d', 'volume_name': 'volume-d358383a-24dd-4607-a873-70a1ad81380d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e620161a-ed15-4553-94fe-8f5492bbfb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e620161a-ed15-4553-94fe-8f5492bbfb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9318a99c-7b11-4e42-a183-8267209fc524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:14 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume d358383a-24dd-4607-a873-70a1ad81380d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d358383a-24dd-4607-a873-70a1ad81380d', 'volume_size': 1}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:14 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d" returned: 0 in 0.424s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-809454914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a41054-e171-425f-81aa-a4ec7f9ceeb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee604c7ca4d54db39df90479d54a1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:14Z,use_quota=True,user_id='71ae896ebac743ed9821b3c49dab4ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Creating volume 85a41054-e171-425f-81aa-a4ec7f9ceeb5 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:03:14 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb1072a-1fe4-40fe-9205-1649154ca691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0d308d-7f39-48e4-88d2-8e4705838ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:14 devstack sudo[101993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5 1073741824
Jul 14 18:03:14 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:14 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d (7fd6db3b-5e45-40f8-9ef0-7c2402cc886d): created successfully
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0d308d-7f39-48e4-88d2-8e4705838ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Flow 'volume_create_manager' (74834309-05d3-4345-9d97-1271094d27a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a2c32cdb-057a-4104-9de7-74e30b63983e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Created volume successfully.
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Flow 'volume_create_manager' (4fcdd3a9-ece6-4b5c-987e-9c3a407f1357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea49f93c-3cfd-4c0c-ab77-14517de2aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea49f93c-3cfd-4c0c-ab77-14517de2aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766763462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43fff7e-6d40-41ab-8c51-ca757fae3a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee604c7ca4d54db39df90479d54a1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:15Z,use_quota=True,user_id='71ae896ebac743ed9821b3c49dab4ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f9c1c5-5c58-4fe3-8047-8491b5a8f20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f9c1c5-5c58-4fe3-8047-8491b5a8f20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a792a4df-4170-4758-b7fa-99ecbc679bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a792a4df-4170-4758-b7fa-99ecbc679bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43fff7e-6d40-41ab-8c51-ca757fae3a50', 'volume_name': 'volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25587b09-0acc-4a76-aa87-72ee305b8d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25587b09-0acc-4a76-aa87-72ee305b8d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e85ee5-5ba8-4966-89ef-a0a43ab382e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:15 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume b43fff7e-6d40-41ab-8c51-ca757fae3a50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50', 'volume_size': 1}
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:15 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5 1073741824" returned: 0 in 0.859s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:15 devstack sudo[102048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5
Jul 14 18:03:15 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Flow 'volume_create_manager' (6a842d5b-252b-4049-977f-7993f379850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba608836-0776-4189-9f3b-d90171742929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba608836-0776-4189-9f3b-d90171742929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1555125615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c867f2-3beb-44d0-9834-da546372a55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee604c7ca4d54db39df90479d54a1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:16Z,use_quota=True,user_id='71ae896ebac743ed9821b3c49dab4ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63395f56-931c-49e8-a9c6-a3cdddf82725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63395f56-931c-49e8-a9c6-a3cdddf82725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6579a624-4d18-4ffc-86c1-75f1a452cbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6579a624-4d18-4ffc-86c1-75f1a452cbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c867f2-3beb-44d0-9834-da546372a55d', 'volume_name': 'volume-66c867f2-3beb-44d0-9834-da546372a55d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a487b062-afec-474e-9924-3da684e6bbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a487b062-afec-474e-9924-3da684e6bbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5354ab0-b5ea-42f1-bfdf-7a13eca7d2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:16 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume 66c867f2-3beb-44d0-9834-da546372a55d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c867f2-3beb-44d0-9834-da546372a55d', 'volume_size': 1}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:16 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5" returned: 0 in 0.430s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.486s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-436581292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d358383a-24dd-4607-a873-70a1ad81380d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee604c7ca4d54db39df90479d54a1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:14Z,use_quota=True,user_id='71ae896ebac743ed9821b3c49dab4ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Creating volume d358383a-24dd-4607-a873-70a1ad81380d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:03:16 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d358383a-24dd-4607-a873-70a1ad81380d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31e92f7-7a10-433a-94cf-a8891381f7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:16 devstack sudo[102054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d358383a-24dd-4607-a873-70a1ad81380d 1073741824
Jul 14 18:03:16 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c9945b-aa7c-4951-8e84-59fc1d8ea7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:16 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5 (85a41054-e171-425f-81aa-a4ec7f9ceeb5): created successfully
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c9945b-aa7c-4951-8e84-59fc1d8ea7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Flow 'volume_create_manager' (7d0dca66-5e37-4d06-af43-a1600e2d1eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a858d316-74d1-4fc1-8581-aa66f316aac8 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Created volume successfully.
Jul 14 18:03:16 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d358383a-24dd-4607-a873-70a1ad81380d 1073741824" returned: 0 in 0.516s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d358383a-24dd-4607-a873-70a1ad81380d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:16 devstack sudo[102061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d358383a-24dd-4607-a873-70a1ad81380d
Jul 14 18:03:16 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:17 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d358383a-24dd-4607-a873-70a1ad81380d" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.737s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766763462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43fff7e-6d40-41ab-8c51-ca757fae3a50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee604c7ca4d54db39df90479d54a1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:15Z,use_quota=True,user_id='71ae896ebac743ed9821b3c49dab4ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Creating volume b43fff7e-6d40-41ab-8c51-ca757fae3a50 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:03:17 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9318a99c-7b11-4e42-a183-8267209fc524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d358383a-24dd-4607-a873-70a1ad81380d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:17 devstack sudo[102064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50 1073741824
Jul 14 18:03:17 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355fbab7-e2be-4b45-9d1b-61b6818bf5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume volume-d358383a-24dd-4607-a873-70a1ad81380d (d358383a-24dd-4607-a873-70a1ad81380d): created successfully
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355fbab7-e2be-4b45-9d1b-61b6818bf5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Flow 'volume_create_manager' (386ec56b-5676-4677-bdc6-6aac32845235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:17 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e8cee17e-faa0-4332-8213-e23e177f3725 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Created volume successfully.
Jul 14 18:03:17 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50 1073741824" returned: 0 in 0.538s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:17 devstack sudo[102070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50
Jul 14 18:03:17 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:17 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50" returned: 0 in 0.290s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.825s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1555125615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c867f2-3beb-44d0-9834-da546372a55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee604c7ca4d54db39df90479d54a1a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:16Z,use_quota=True,user_id='71ae896ebac743ed9821b3c49dab4ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Creating volume 66c867f2-3beb-44d0-9834-da546372a55d {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:03:17 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-66c867f2-3beb-44d0-9834-da546372a55d 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e85ee5-5ba8-4966-89ef-a0a43ab382e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686369f3-6995-4539-94e2-a17adb3d62c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:17 devstack sudo[102073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-66c867f2-3beb-44d0-9834-da546372a55d 1073741824
Jul 14 18:03:17 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50 (b43fff7e-6d40-41ab-8c51-ca757fae3a50): created successfully
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686369f3-6995-4539-94e2-a17adb3d62c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Flow 'volume_create_manager' (4fcdd3a9-ece6-4b5c-987e-9c3a407f1357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-59ae993e-cd73-4fae-8940-8daa7757a609 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Created volume successfully.
Jul 14 18:03:18 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-66c867f2-3beb-44d0-9834-da546372a55d 1073741824" returned: 0 in 0.654s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-66c867f2-3beb-44d0-9834-da546372a55d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:18 devstack sudo[102079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-66c867f2-3beb-44d0-9834-da546372a55d
Jul 14 18:03:18 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Flow 'volume_create_manager' (52a52389-6ba2-4cad-98c9-9ac4b9373d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf54c148-9f48-49f7-8b4d-2d23273deed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf54c148-9f48-49f7-8b4d-2d23273deed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2060808602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ca5bc3-310b-4c6f-afa3-05c68a864a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181c20d8d1f34a079d76f79577971c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:19Z,use_quota=True,user_id='2b8eed71ef0741ebaebdcab7e228762a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68244587-1224-4acf-bcf9-5a4a07858556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68244587-1224-4acf-bcf9-5a4a07858556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd940606-97f9-4e8a-92cf-b7984b15cf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd940606-97f9-4e8a-92cf-b7984b15cf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ca5bc3-310b-4c6f-afa3-05c68a864a57', 'volume_name': 'volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2656ba4-0c54-4c52-9a07-1b6b9f776c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2656ba4-0c54-4c52-9a07-1b6b9f776c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63e281b-099b-46b3-b1d0-536b1e015e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Volume 20ca5bc3-310b-4c6f-afa3-05c68a864a57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57', 'volume_size': 1}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:18 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-66c867f2-3beb-44d0-9834-da546372a55d" returned: 0 in 0.298s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.120s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2060808602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ca5bc3-310b-4c6f-afa3-05c68a864a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181c20d8d1f34a079d76f79577971c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:03:19Z,use_quota=True,user_id='2b8eed71ef0741ebaebdcab7e228762a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Creating volume 20ca5bc3-310b-4c6f-afa3-05c68a864a57 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:03:18 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5354ab0-b5ea-42f1-bfdf-7a13eca7d2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c867f2-3beb-44d0-9834-da546372a55d', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:18 devstack sudo[102082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57 1073741824
Jul 14 18:03:18 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0835f84-b327-420c-9ba3-348e5d455b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Volume volume-66c867f2-3beb-44d0-9834-da546372a55d (66c867f2-3beb-44d0-9834-da546372a55d): created successfully
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0835f84-b327-420c-9ba3-348e5d455b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Flow 'volume_create_manager' (6a842d5b-252b-4049-977f-7993f379850b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-624269fd-23fd-427f-97a8-de6640cf6b52 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Created volume successfully.
Jul 14 18:03:19 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57 1073741824" returned: 0 in 0.426s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:19 devstack sudo[102087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57
Jul 14 18:03:19 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "cinder-66c867f2-3beb-44d0-9834-da546372a55d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-66c867f2-3beb-44d0-9834-da546372a55d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "cinder-quobyte-66c867f2-3beb-44d0-9834-da546372a55d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-quobyte-66c867f2-3beb-44d0-9834-da546372a55d" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14c0447-a484-4fff-af09-6b6ff3b425cf]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-66c867f2-3beb-44d0-9834-da546372a55d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:19 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57" returned: 0 in 0.326s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63e281b-099b-46b3-b1d0-536b1e015e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3beb42-c912-46e8-9f26-8000781275b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:03:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Volume volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57 (20ca5bc3-310b-4c6f-afa3-05c68a864a57): created successfully
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3beb42-c912-46e8-9f26-8000781275b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:03:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Flow 'volume_create_manager' (52a52389-6ba2-4cad-98c9-9ac4b9373d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:03:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-07aa1f0e-4c83-42e0-bac7-385bedc1fd29 tempest-TestMinimumBasicScenario-389936622 None] Created volume successfully.
Jul 14 18:03:19 devstack sudo[102091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-66c867f2-3beb-44d0-9834-da546372a55d
Jul 14 18:03:19 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:20 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-66c867f2-3beb-44d0-9834-da546372a55d" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-66c867f2-3beb-44d0-9834-da546372a55d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:20 devstack sudo[102097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-66c867f2-3beb-44d0-9834-da546372a55d
Jul 14 18:03:20 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:20 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-66c867f2-3beb-44d0-9834-da546372a55d" returned: 0 in 0.233s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-quobyte-66c867f2-3beb-44d0-9834-da546372a55d" released by "delete_volume" :: held 0.669s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Created reservations ['ae7a16c3-81d1-4bff-aa94-a051b6ed724d', '99638ba2-5d3c-4e73-9e73-7bafa37fd65d', 'ca07192c-f23c-43b7-bcfd-e4a4dfbac39d', '50deb3c0-6c31-4509-8674-2dc662bb3825'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:20 devstack sudo[102100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:03:20 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:20 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:03:20 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Deleted volume successfully.
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "cinder-b43fff7e-6d40-41ab-8c51-ca757fae3a50-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-feeae434-914a-4197-98c5-81e1ed93006e tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-66c867f2-3beb-44d0-9834-da546372a55d-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-b43fff7e-6d40-41ab-8c51-ca757fae3a50-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "cinder-quobyte-b43fff7e-6d40-41ab-8c51-ca757fae3a50" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:20 devstack sudo[102103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:03:20 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-quobyte-b43fff7e-6d40-41ab-8c51-ca757fae3a50" acquired by "delete_volume" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ed989-1545-4911-9985-011c296d9e9b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:03:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:21 devstack sudo[102105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50
Jul 14 18:03:21 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:21 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:03:21 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50" returned: 0 in 0.480s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:21 devstack sudo[102114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50
Jul 14 18:03:21 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:21 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b43fff7e-6d40-41ab-8c51-ca757fae3a50" returned: 0 in 0.301s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-quobyte-b43fff7e-6d40-41ab-8c51-ca757fae3a50" released by "delete_volume" :: held 0.853s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Created reservations ['ca1ae21b-a340-42ba-9dd0-2d212e1aab51', 'adffda8e-bdd6-4110-91c0-660a65d2fb13', '8150fff0-513e-44c8-8674-77e75cf3a5d0', '7e8f42c0-9a82-49bf-95f4-7865af66c613'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:21 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:03:21 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "cinder-d358383a-24dd-4607-a873-70a1ad81380d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-d358383a-24dd-4607-a873-70a1ad81380d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "cinder-quobyte-d358383a-24dd-4607-a873-70a1ad81380d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-quobyte-d358383a-24dd-4607-a873-70a1ad81380d" acquired by "delete_volume" :: waited 0.042s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fc43e7-bde9-4e8d-b0c7-c3627fd7775d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d358383a-24dd-4607-a873-70a1ad81380d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5c57ae16-f60b-4c9f-b03b-b3f798ba9dca req-087c58ab-5bb1-49b1-8c8b-0642ef58bb25 tempest-TestMinimumBasicScenario-389936622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5c57ae16-f60b-4c9f-b03b-b3f798ba9dca req-087c58ab-5bb1-49b1-8c8b-0642ef58bb25 tempest-TestMinimumBasicScenario-389936622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0c0bd5-4f40-4576-b7bc-9b9f40b8db95]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5c57ae16-f60b-4c9f-b03b-b3f798ba9dca req-087c58ab-5bb1-49b1-8c8b-0642ef58bb25 tempest-TestMinimumBasicScenario-389936622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:22 devstack sudo[102127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d358383a-24dd-4607-a873-70a1ad81380d
Jul 14 18:03:22 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:22 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.374s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:03:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Deleted volume successfully.
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca399f6b-765b-4315-824a-46f4a408adfa tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-b43fff7e-6d40-41ab-8c51-ca757fae3a50-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:22 devstack sudo[102128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57
Jul 14 18:03:22 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:22 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d358383a-24dd-4607-a873-70a1ad81380d" returned: 0 in 0.410s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d358383a-24dd-4607-a873-70a1ad81380d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:22 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d358383a-24dd-4607-a873-70a1ad81380d
Jul 14 18:03:22 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:22 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5c57ae16-f60b-4c9f-b03b-b3f798ba9dca req-087c58ab-5bb1-49b1-8c8b-0642ef58bb25 tempest-TestMinimumBasicScenario-389936622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57" returned: 0 in 0.407s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5c57ae16-f60b-4c9f-b03b-b3f798ba9dca req-087c58ab-5bb1-49b1-8c8b-0642ef58bb25 tempest-TestMinimumBasicScenario-389936622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.430s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5c57ae16-f60b-4c9f-b03b-b3f798ba9dca req-087c58ab-5bb1-49b1-8c8b-0642ef58bb25 tempest-TestMinimumBasicScenario-389936622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c449401-845b-49c6-8c62-c9460859e1f6', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 18:03:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-5c57ae16-f60b-4c9f-b03b-b3f798ba9dca req-087c58ab-5bb1-49b1-8c8b-0642ef58bb25 tempest-TestMinimumBasicScenario-389936622 None] attachment_update completed successfully.
Jul 14 18:03:22 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d358383a-24dd-4607-a873-70a1ad81380d" returned: 0 in 0.332s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-quobyte-d358383a-24dd-4607-a873-70a1ad81380d" released by "delete_volume" :: held 0.798s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:22 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Created reservations ['bf608875-6464-4fb2-b9d7-7391c91e3d73', '01cd7a65-07d7-4d09-a8f3-f4185853aa26', '8033162f-ab08-425c-a4e3-d9af9a0b5a99', '8a66e5b7-df62-41e3-996b-94a067cf4efc'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:23 devstack sudo[102255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:03:23 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "cinder-85a41054-e171-425f-81aa-a4ec7f9ceeb5-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-85a41054-e171-425f-81aa-a4ec7f9ceeb5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "cinder-quobyte-85a41054-e171-425f-81aa-a4ec7f9ceeb5" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-quobyte-85a41054-e171-425f-81aa-a4ec7f9ceeb5" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a19faed-476a-4b9d-8c4f-75f6a0324ac4]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:23 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.330s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:03:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Deleted volume successfully.
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-741b37fd-e039-49bf-a29b-ac25eece3ad9 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-d358383a-24dd-4607-a873-70a1ad81380d-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:23 devstack sudo[102527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5
Jul 14 18:03:23 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:23 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5" returned: 0 in 0.409s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:23 devstack sudo[102532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5
Jul 14 18:03:23 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:24 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-85a41054-e171-425f-81aa-a4ec7f9ceeb5" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-quobyte-85a41054-e171-425f-81aa-a4ec7f9ceeb5" released by "delete_volume" :: held 0.755s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Created reservations ['95d4a137-9472-4957-ac7d-8e37e1e86b5b', '1397963b-31c0-48f1-bfef-51a5bc0e18c5', '6ad38450-87fb-407c-b186-5ba729becc9d', '6545ff78-ec5b-4efe-a32d-d18955c76977'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:24 devstack sudo[102535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:03:24 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "cinder-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "cinder-quobyte-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-quobyte-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0980c670-9556-47b8-ba28-eeed196f354a]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:24 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.415s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:03:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Deleted volume successfully.
Jul 14 18:03:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c3649c32-c071-4fb0-8cd7-bc2d70134d4c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-85a41054-e171-425f-81aa-a4ec7f9ceeb5-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:24 devstack sudo[102537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d
Jul 14 18:03:24 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:25 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d" returned: 0 in 0.468s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:25 devstack sudo[102543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d
Jul 14 18:03:25 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:25 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d" returned: 0 in 0.275s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-quobyte-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d" released by "delete_volume" :: held 0.795s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Created reservations ['3b9e0292-70b6-403a-9283-f06a7d391491', '3eb499f1-5060-4321-bac8-58a699965e3c', 'f432c600-3f8c-4d21-9479-984067521239', '7e98b867-482a-4d45-9aba-cc9b7819641f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:25 devstack sudo[102546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:03:25 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "cinder-0ba35704-a9c0-43a4-8d75-b6e6303b4f62-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-0ba35704-a9c0-43a4-8d75-b6e6303b4f62-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "cinder-quobyte-0ba35704-a9c0-43a4-8d75-b6e6303b4f62" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-quobyte-0ba35704-a9c0-43a4-8d75-b6e6303b4f62" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:03:25 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.344s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:03:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Deleted volume successfully.
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff3508b-6d79-4793-b7a8-81e09e857df3]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-60a6c7de-4fe1-49f5-bfce-e8881382e77c tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-7fd6db3b-5e45-40f8-9ef0-7c2402cc886d-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:26 devstack sudo[102549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62
Jul 14 18:03:26 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:26 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62" returned: 0 in 0.382s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:26 devstack sudo[102554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62
Jul 14 18:03:26 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:26 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0ba35704-a9c0-43a4-8d75-b6e6303b4f62" returned: 0 in 0.255s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:26 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-quobyte-0ba35704-a9c0-43a4-8d75-b6e6303b4f62" released by "delete_volume" :: held 0.705s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:26 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Created reservations ['6da628d5-bdc1-4a54-9719-5b1ea0d3dbc6', '57c0e057-890c-4db1-abac-1d8b06231f32', '0219a366-b4a9-474b-a85c-7a35497ed477', '861a5f2d-9e29-4a7e-8ef6-e3afa38c275f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:03:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:03:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:03:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:03:26 devstack sudo[102558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:03:26 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:03:27 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root
Jul 14 18:03:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.299s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:03:27 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:03:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Deleted volume successfully.
Jul 14 18:03:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a55d332b-5cbb-4ecc-9b1a-d6ae49d63930 tempest-CreateVolumesFromSourceVolumeTest-1467101188 None] Lock "cinder-0ba35704-a9c0-43a4-8d75-b6e6303b4f62-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:03:36 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=69,cinder:INSERT=21,cinder:UPDATE=103,cinder:DELETE=4 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:03:37 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=65,cinder:INSERT=29,cinder:UPDATE=78,cinder:DELETE=12 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:04:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-e13275f0-a917-4575-a177-c86ac1935131 req-ad6460f3-5e28-452d-bf75-c7e5588312ec tempest-TestMinimumBasicScenario-389936622 None] Terminate volume connection completed successfully.
Jul 14 18:04:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-e13275f0-a917-4575-a177-c86ac1935131 req-ad6460f3-5e28-452d-bf75-c7e5588312ec tempest-TestMinimumBasicScenario-389936622 None] Deleting attachment 7c449401-845b-49c6-8c62-c9460859e1f6. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 18:04:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Acquiring lock "cinder-20ca5bc3-310b-4c6f-afa3-05c68a864a57-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:04:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Lock "cinder-20ca5bc3-310b-4c6f-afa3-05c68a864a57-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:04:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Acquiring lock "cinder-quobyte-20ca5bc3-310b-4c6f-afa3-05c68a864a57" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:04:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Lock "cinder-quobyte-20ca5bc3-310b-4c6f-afa3-05c68a864a57" acquired by "delete_volume" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:04:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbed265e-864a-4a93-8b6a-3e3000c92915]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:04:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:04:08 devstack sudo[102710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57
Jul 14 18:04:08 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:04:08 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root
Jul 14 18:04:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57" returned: 0 in 0.348s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:04:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:04:08 devstack sudo[102715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57
Jul 14 18:04:08 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:04:09 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root
Jul 14 18:04:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20ca5bc3-310b-4c6f-afa3-05c68a864a57" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:04:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Lock "cinder-quobyte-20ca5bc3-310b-4c6f-afa3-05c68a864a57" released by "delete_volume" :: held 0.622s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:04:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Created reservations ['5a222d5b-3ff8-4b1d-846e-0216628d54bc', 'f66b377a-560e-4971-8506-677795980e60', 'd38081ac-9eb9-4fc8-bbc5-9b10b170cce4', 'd7120ee1-5a3b-465d-87e9-1b05ef63b89f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:04:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:04:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:04:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:04:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:04:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:04:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:04:09 devstack sudo[102718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:04:09 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:04:09 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root
Jul 14 18:04:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.232s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:04:09 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:04:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Deleted volume successfully.
Jul 14 18:04:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-82054586-3372-4531-9aee-fb0bfbffa8bb tempest-TestMinimumBasicScenario-389936622 None] Lock "cinder-20ca5bc3-310b-4c6f-afa3-05c68a864a57-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:04:19 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:04:19 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:04:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:04:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:04:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:04:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:04:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:04:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:04:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:04:20 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:04:20 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:04:21 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Jul 14 18:04:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.242s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:04:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:04:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:04:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:04:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Flow 'volume_create_manager' (4a4c3e4a-f24d-41bb-bf0b-55cdc29b6ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188ceeff-c026-493e-b219-56b3ecf1b9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188ceeff-c026-493e-b219-56b3ecf1b9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1970274939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe48775-2232-4d52-be2a-ba4badd4d189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8612f10cd34ccda3cc9d8812ee85c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:04:36Z,use_quota=True,user_id='73ca934d02de4c538746932091a66281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef0d3c4-a33f-4041-9722-2bac504143d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef0d3c4-a33f-4041-9722-2bac504143d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5cc2cd-4c86-4e93-9fd6-0f5535c05805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5cc2cd-4c86-4e93-9fd6-0f5535c05805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe48775-2232-4d52-be2a-ba4badd4d189', 'volume_name': 'volume-cfe48775-2232-4d52-be2a-ba4badd4d189', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2067aa-e95e-47b9-9872-859e6253b8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2067aa-e95e-47b9-9872-859e6253b8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e249da8-8f52-478b-8ad1-1e0e57f5d0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:04:36 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Volume cfe48775-2232-4d52-be2a-ba4badd4d189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe48775-2232-4d52-be2a-ba4badd4d189', 'volume_size': 1}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1970274939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe48775-2232-4d52-be2a-ba4badd4d189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8612f10cd34ccda3cc9d8812ee85c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:04:36Z,use_quota=True,user_id='73ca934d02de4c538746932091a66281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Creating volume cfe48775-2232-4d52-be2a-ba4badd4d189 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:04:36 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:04:36 devstack sudo[102758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189 1073741824
Jul 14 18:04:36 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Flow 'volume_create_manager' (00386f47-4994-49dc-aa5d-7fe79a05ab2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bf7d93-43a6-4fe5-b3fc-66049f150254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bf7d93-43a6-4fe5-b3fc-66049f150254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-330582694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c24174-7ded-404d-8e0e-a5a7374ba8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8612f10cd34ccda3cc9d8812ee85c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:04:37Z,use_quota=True,user_id='73ca934d02de4c538746932091a66281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e0564e-2297-40aa-a814-023812139a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e0564e-2297-40aa-a814-023812139a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b449445-c267-4800-b1d7-5ab7e296fb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b449445-c267-4800-b1d7-5ab7e296fb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c24174-7ded-404d-8e0e-a5a7374ba8dc', 'volume_name': 'volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a346cfc0-3eaa-44f3-9079-63243242fff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a346cfc0-3eaa-44f3-9079-63243242fff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0f558a-04c4-48d1-9d20-9552e377ec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:04:36 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Volume b2c24174-7ded-404d-8e0e-a5a7374ba8dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc', 'volume_size': 1}
Jul 14 18:04:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:04:37 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189 1073741824" returned: 0 in 0.519s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:04:37 devstack sudo[102763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189
Jul 14 18:04:37 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:04:37 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189" returned: 0 in 0.282s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.484s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-330582694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c24174-7ded-404d-8e0e-a5a7374ba8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8612f10cd34ccda3cc9d8812ee85c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:04:37Z,use_quota=True,user_id='73ca934d02de4c538746932091a66281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Creating volume b2c24174-7ded-404d-8e0e-a5a7374ba8dc {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:04:37 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e249da8-8f52-478b-8ad1-1e0e57f5d0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe48775-2232-4d52-be2a-ba4badd4d189', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:04:37 devstack sudo[102766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc 1073741824
Jul 14 18:04:37 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fb94c6-94aa-46d5-a0a1-19e28aaeac28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:04:37 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Volume volume-cfe48775-2232-4d52-be2a-ba4badd4d189 (cfe48775-2232-4d52-be2a-ba4badd4d189): created successfully
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fb94c6-94aa-46d5-a0a1-19e28aaeac28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Flow 'volume_create_manager' (4a4c3e4a-f24d-41bb-bf0b-55cdc29b6ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:04:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-42c34354-0759-4a8a-93cf-a5da1e266858 tempest-TestServerVolumeAttachmentScenario-498113815 None] Created volume successfully.
Jul 14 18:04:37 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc 1073741824" returned: 0 in 0.501s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:04:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:04:37 devstack sudo[102772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc
Jul 14 18:04:37 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:04:38 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root
Jul 14 18:04:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:04:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:04:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:04:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0f558a-04c4-48d1-9d20-9552e377ec99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:04:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a08ceb7-9a68-44cb-b57d-bde0eef296a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:04:38 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Volume volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc (b2c24174-7ded-404d-8e0e-a5a7374ba8dc): created successfully
Jul 14 18:04:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a08ceb7-9a68-44cb-b57d-bde0eef296a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:04:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Flow 'volume_create_manager' (00386f47-4994-49dc-aa5d-7fe79a05ab2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:04:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a82069e4-0d0f-414a-9ff3-f21cb139e67e tempest-TestServerVolumeAttachmentScenario-498113815 None] Created volume successfully.
Jul 14 18:04:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:04:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=8,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:05:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7f111f3b-fc51-41cc-9f50-ccec20fbfc3b req-d9d88210-71e6-4eb4-b260-6a50aea29c29 tempest-TestServerVolumeAttachmentScenario-498113815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:05:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7f111f3b-fc51-41cc-9f50-ccec20fbfc3b req-d9d88210-71e6-4eb4-b260-6a50aea29c29 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:05:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[99204cf0-776b-477a-9287-b452d04af753]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:05:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7f111f3b-fc51-41cc-9f50-ccec20fbfc3b req-d9d88210-71e6-4eb4-b260-6a50aea29c29 tempest-TestServerVolumeAttachmentScenario-498113815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:05:08 devstack sudo[102947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189
Jul 14 18:05:08 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:05:08 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root
Jul 14 18:05:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-7f111f3b-fc51-41cc-9f50-ccec20fbfc3b req-d9d88210-71e6-4eb4-b260-6a50aea29c29 tempest-TestServerVolumeAttachmentScenario-498113815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:05:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-7f111f3b-fc51-41cc-9f50-ccec20fbfc3b req-d9d88210-71e6-4eb4-b260-6a50aea29c29 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.361s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:05:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-7f111f3b-fc51-41cc-9f50-ccec20fbfc3b req-d9d88210-71e6-4eb4-b260-6a50aea29c29 tempest-TestServerVolumeAttachmentScenario-498113815 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-cfe48775-2232-4d52-be2a-ba4badd4d189', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aef28bb3-d9a8-4a4e-95af-4545281e4cc4', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 18:05:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-7f111f3b-fc51-41cc-9f50-ccec20fbfc3b req-d9d88210-71e6-4eb4-b260-6a50aea29c29 tempest-TestServerVolumeAttachmentScenario-498113815 None] attachment_update completed successfully.
Jul 14 18:05:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-3e06766f-4070-49d2-b01b-1cdb67ced9b3 req-e1816c77-d058-4102-ad0e-85d14f05e78c tempest-TestServerVolumeAttachmentScenario-498113815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:05:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-3e06766f-4070-49d2-b01b-1cdb67ced9b3 req-e1816c77-d058-4102-ad0e-85d14f05e78c tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:05:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[becc5e7f-5070-4fce-9255-c3d25b28e037]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:05:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-3e06766f-4070-49d2-b01b-1cdb67ced9b3 req-e1816c77-d058-4102-ad0e-85d14f05e78c tempest-TestServerVolumeAttachmentScenario-498113815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:05:13 devstack sudo[103347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc
Jul 14 18:05:13 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:05:13 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root
Jul 14 18:05:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-3e06766f-4070-49d2-b01b-1cdb67ced9b3 req-e1816c77-d058-4102-ad0e-85d14f05e78c tempest-TestServerVolumeAttachmentScenario-498113815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc" returned: 0 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:05:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-3e06766f-4070-49d2-b01b-1cdb67ced9b3 req-e1816c77-d058-4102-ad0e-85d14f05e78c tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.385s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:05:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-3e06766f-4070-49d2-b01b-1cdb67ced9b3 req-e1816c77-d058-4102-ad0e-85d14f05e78c tempest-TestServerVolumeAttachmentScenario-498113815 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ec2d0cf-c9ab-47e3-85a6-72865119fe93', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 18:05:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-3e06766f-4070-49d2-b01b-1cdb67ced9b3 req-e1816c77-d058-4102-ad0e-85d14f05e78c tempest-TestServerVolumeAttachmentScenario-498113815 None] attachment_update completed successfully.
Jul 14 18:05:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-4d0c4ec3-96ac-471b-93a7-d8c5c9ecc4c4 req-1c10d71a-48e4-46dc-911f-e0f732b879ea tempest-TestServerVolumeAttachmentScenario-498113815 None] Terminate volume connection completed successfully.
Jul 14 18:05:15 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-4d0c4ec3-96ac-471b-93a7-d8c5c9ecc4c4 req-1c10d71a-48e4-46dc-911f-e0f732b879ea tempest-TestServerVolumeAttachmentScenario-498113815 None] Deleting attachment 4ec2d0cf-c9ab-47e3-85a6-72865119fe93. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 18:05:17 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-5d26b1f7-65f0-45f1-b2d6-08ab69aa1522 req-9b2de698-0397-4141-b4a5-ace2462077cf tempest-TestServerVolumeAttachmentScenario-498113815 None] Terminate volume connection completed successfully.
Jul 14 18:05:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5d26b1f7-65f0-45f1-b2d6-08ab69aa1522 req-9b2de698-0397-4141-b4a5-ace2462077cf tempest-TestServerVolumeAttachmentScenario-498113815 None] Deleting attachment aef28bb3-d9a8-4a4e-95af-4545281e4cc4. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 18:05:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:05:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:05:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:05:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:05:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:05:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:05:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:05:20 devstack sudo[103412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:05:20 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:05:21 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.251s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Acquiring lock "cinder-b2c24174-7ded-404d-8e0e-a5a7374ba8dc-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "cinder-b2c24174-7ded-404d-8e0e-a5a7374ba8dc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Acquiring lock "cinder-quobyte-b2c24174-7ded-404d-8e0e-a5a7374ba8dc" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "cinder-quobyte-b2c24174-7ded-404d-8e0e-a5a7374ba8dc" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7b653a-2cc2-4966-a089-60a061ab2c75]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:05:21 devstack sudo[103415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc
Jul 14 18:05:21 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:05:21 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc" returned: 0 in 0.349s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:05:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:05:21 devstack sudo[103420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc
Jul 14 18:05:21 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:05:22 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b2c24174-7ded-404d-8e0e-a5a7374ba8dc" returned: 0 in 0.237s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "cinder-quobyte-b2c24174-7ded-404d-8e0e-a5a7374ba8dc" released by "delete_volume" :: held 0.626s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Created reservations ['03ef6c06-cb64-41a3-8240-e35deef9b3dc', '10ed4005-86b3-479e-b7f2-a24f5d95d5b4', '21945022-29cd-49ad-ac54-6a552209af45', '5f41d43d-0b80-418e-b450-32c3417fc779'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:05:22 devstack sudo[103423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:05:22 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:05:22 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.244s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:05:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Deleted volume successfully.
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5dc13a8d-0a41-490e-9cb8-b8dd94dcfb27 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "cinder-b2c24174-7ded-404d-8e0e-a5a7374ba8dc-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Acquiring lock "cinder-cfe48775-2232-4d52-be2a-ba4badd4d189-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "cinder-cfe48775-2232-4d52-be2a-ba4badd4d189-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Acquiring lock "cinder-quobyte-cfe48775-2232-4d52-be2a-ba4badd4d189" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "cinder-quobyte-cfe48775-2232-4d52-be2a-ba4badd4d189" acquired by "delete_volume" :: waited 0.012s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3330fb49-20b6-4f1d-b880-52033ed3cf90]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:05:22 devstack sudo[103426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189
Jul 14 18:05:22 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:05:22 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:05:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:05:22 devstack sudo[103431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189
Jul 14 18:05:22 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:05:23 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root
Jul 14 18:05:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-cfe48775-2232-4d52-be2a-ba4badd4d189" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:05:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "cinder-quobyte-cfe48775-2232-4d52-be2a-ba4badd4d189" released by "delete_volume" :: held 0.621s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:05:23 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Created reservations ['79509ecb-b21a-48dd-9047-46985c3152a7', 'f519b3cb-d3a3-44c8-bad1-09184a1f6763', '6f22a7d0-af96-4741-8998-c265f956a081', 'fc6f6d59-f9b6-49e7-b967-3528383613fc'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:05:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:05:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:05:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:05:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:05:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:05:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:05:23 devstack sudo[103434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:05:23 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:05:23 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root
Jul 14 18:05:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.230s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:05:23 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:05:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Deleted volume successfully.
Jul 14 18:05:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8eb1c341-cc22-4afa-bb8a-bda888f80663 tempest-TestServerVolumeAttachmentScenario-498113815 None] Lock "cinder-cfe48775-2232-4d52-be2a-ba4badd4d189-delete_volume" released by "delete_volume" :: held 1.026s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:05:33 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=28,cinder:UPDATE=20,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:05:33 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=18,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Flow 'volume_create_manager' (74a86703-9081-48ce-8b8e-98a7ab746b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb11fcb-9a99-4937-aeb7-373e5f1decff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb11fcb-9a99-4937-aeb7-373e5f1decff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1880151523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2576d8-4d0f-42b1-8472-ce634de05c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a918b946d1410bacd4cda9b2c2bcbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:05:51Z,use_quota=True,user_id='bbcb91270cad49b6b3e0699124abca56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86e9796-169e-4005-9fcc-9202710e8bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86e9796-169e-4005-9fcc-9202710e8bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeb45a9-de8b-45f7-8e3a-129d3b9861ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeb45a9-de8b-45f7-8e3a-129d3b9861ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2576d8-4d0f-42b1-8472-ce634de05c40', 'volume_name': 'volume-9d2576d8-4d0f-42b1-8472-ce634de05c40', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b37dbf-d8f3-4117-8160-792aace19be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b37dbf-d8f3-4117-8160-792aace19be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41f253c-da76-496e-9d78-c3aaf7a0ef31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:05:51 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Volume 9d2576d8-4d0f-42b1-8472-ce634de05c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2576d8-4d0f-42b1-8472-ce634de05c40', 'volume_size': 1}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1880151523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2576d8-4d0f-42b1-8472-ce634de05c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a918b946d1410bacd4cda9b2c2bcbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:05:51Z,use_quota=True,user_id='bbcb91270cad49b6b3e0699124abca56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Creating volume 9d2576d8-4d0f-42b1-8472-ce634de05c40 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:05:51 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:05:51 devstack sudo[103480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 1073741824
Jul 14 18:05:51 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:05:51 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 1073741824" returned: 0 in 0.456s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:05:51 devstack sudo[103487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40
Jul 14 18:05:51 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:05:51 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40" returned: 0 in 0.281s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41f253c-da76-496e-9d78-c3aaf7a0ef31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2576d8-4d0f-42b1-8472-ce634de05c40', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b307937-4452-4e7c-b72a-8919bd0f5f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:05:51 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Volume volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 (9d2576d8-4d0f-42b1-8472-ce634de05c40): created successfully
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b307937-4452-4e7c-b72a-8919bd0f5f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:05:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Flow 'volume_create_manager' (74a86703-9081-48ce-8b8e-98a7ab746b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:05:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-675f5fc5-813a-4960-a700-c14d10e36688 tempest-TestStampPattern-1411497321 None] Created volume successfully.
Jul 14 18:06:01 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:06:02 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:06:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:06:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:06:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:06:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:06:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:06:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:06:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:20 devstack sudo[103626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:06:20 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-108adf45-2d6f-4224-80b6-9f5d03a4a856 req-925639bf-5302-45f9-982f-9e6dfe1c10ea tempest-TestStampPattern-1411497321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:06:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-108adf45-2d6f-4224-80b6-9f5d03a4a856 req-925639bf-5302-45f9-982f-9e6dfe1c10ea tempest-TestStampPattern-1411497321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:06:20 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[51793a70-156c-4cdb-9771-b0e8fd9ccee0]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:06:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-108adf45-2d6f-4224-80b6-9f5d03a4a856 req-925639bf-5302-45f9-982f-9e6dfe1c10ea tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:20 devstack sudo[103628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40
Jul 14 18:06:20 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:21 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:06:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:06:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:06:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:06:21 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-108adf45-2d6f-4224-80b6-9f5d03a4a856 req-925639bf-5302-45f9-982f-9e6dfe1c10ea tempest-TestStampPattern-1411497321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-108adf45-2d6f-4224-80b6-9f5d03a4a856 req-925639bf-5302-45f9-982f-9e6dfe1c10ea tempest-TestStampPattern-1411497321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.360s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:06:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-108adf45-2d6f-4224-80b6-9f5d03a4a856 req-925639bf-5302-45f9-982f-9e6dfe1c10ea tempest-TestStampPattern-1411497321 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-9d2576d8-4d0f-42b1-8472-ce634de05c40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c43781e4-ae9c-461b-9543-9540e1ddc39b', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 18:06:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-108adf45-2d6f-4224-80b6-9f5d03a4a856 req-925639bf-5302-45f9-982f-9e6dfe1c10ea tempest-TestStampPattern-1411497321 None] attachment_update completed successfully.
Jul 14 18:06:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-0919ec0f-30e7-4c4a-9877-6de85a7395d7 req-3b084d49-6263-4a3d-92bd-cb276620d5b9 tempest-TestStampPattern-1411497321 None] Terminate volume connection completed successfully.
Jul 14 18:06:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-0919ec0f-30e7-4c4a-9877-6de85a7395d7 req-3b084d49-6263-4a3d-92bd-cb276620d5b9 tempest-TestStampPattern-1411497321 None] Deleting attachment c43781e4-ae9c-461b-9543-9540e1ddc39b. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 18:06:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:06:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:06:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] Creating offline snapshot ff5aebb1-f874-4230-b112-a1b0dbdffd44 of volume 9d2576d8-4d0f-42b1-8472-ce634de05c40 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:06:26 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[38769bc0-68af-485c-b77a-a6c9209bc7fd]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:06:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:26 devstack sudo[104066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40
Jul 14 18:06:26 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:27 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:27 devstack sudo[104072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44 1G
Jul 14 18:06:27 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:27 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44 1G" returned: 0 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:27 devstack sudo[104077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44
Jul 14 18:06:27 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:27 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44" returned: 0 in 0.286s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:27 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44 is being set with open permissions: ugo+rw
Jul 14 18:06:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:27 devstack sudo[104082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44
Jul 14 18:06:27 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:27 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44" returned: 0 in 0.233s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:28 devstack sudo[104085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.info
Jul 14 18:06:28 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:28 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.info" returned: 0 in 0.262s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:28 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.info is being set with open permissions: ugo+rw
Jul 14 18:06:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:28 devstack sudo[104088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.info
Jul 14 18:06:28 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:28 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.info" returned: 0 in 0.241s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:06:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9232cbba-76c6-4308-8c69-74981af205a3 tempest-TestStampPattern-1411497321 None] Create snapshot completed successfully
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Flow 'volume_create_manager' (966126fe-99ac-4473-bf66-fb5eb9a2a837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09169cd0-e528-4bb0-ab9e-1cabf5416c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09169cd0-e528-4bb0-ab9e-1cabf5416c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2147429812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2a1c9a-165b-4cb4-9d20-b007da269708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3a918b946d1410bacd4cda9b2c2bcbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ff5aebb1-f874-4230-b112-a1b0dbdffd44,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:06:34Z,use_quota=True,user_id='bbcb91270cad49b6b3e0699124abca56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b72d1b-64f0-41b0-af33-d0b0953322cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b72d1b-64f0-41b0-af33-d0b0953322cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9f315a-9dd5-490f-b2f5-0d709eeb7866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9f315a-9dd5-490f-b2f5-0d709eeb7866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6a2a1c9a-165b-4cb4-9d20-b007da269708', 'volume_name': 'volume-6a2a1c9a-165b-4cb4-9d20-b007da269708', 'volume_size': 1, 'snapshot_id': 'ff5aebb1-f874-4230-b112-a1b0dbdffd44'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab84c69-9045-4c4a-9f25-5fa2a20d4889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab84c69-9045-4c4a-9f25-5fa2a20d4889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc77221c-8582-4073-8d81-7f2941abfcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:06:34 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Volume 6a2a1c9a-165b-4cb4-9d20-b007da269708: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6a2a1c9a-165b-4cb4-9d20-b007da269708', 'volume_size': 1, 'snapshot_id': 'ff5aebb1-f874-4230-b112-a1b0dbdffd44'}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Acquiring lock "cinder-quobyte-ff5aebb1-f874-4230-b112-a1b0dbdffd44-6a2a1c9a-165b-4cb4-9d20-b007da269708" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Lock "cinder-quobyte-ff5aebb1-f874-4230-b112-a1b0dbdffd44-6a2a1c9a-165b-4cb4-9d20-b007da269708" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Creating volume 6a2a1c9a-165b-4cb4-9d20-b007da269708 from snapshot ff5aebb1-f874-4230-b112-a1b0dbdffd44 {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Acquiring lock "cinder-quobyte-6a2a1c9a-165b-4cb4-9d20-b007da269708" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Lock "cinder-quobyte-6a2a1c9a-165b-4cb4-9d20-b007da269708" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] snapshot: ff5aebb1-f874-4230-b112-a1b0dbdffd44, volume: 6a2a1c9a-165b-4cb4-9d20-b007da269708,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a555834-be08-4ca0-ba34-06d82f790494]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:34 devstack sudo[104116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44
Jul 14 18:06:34 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:34 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44" returned: 0 in 0.374s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d2576d8-4d0f-42b1-8472-ce634de05c40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e36be5b-e923-4546-b5de-8f9811843dce]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:06:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:34 devstack sudo[104121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40
Jul 14 18:06:34 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:35 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40" returned: 0 in 0.377s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:35 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Path /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 18:06:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:35 devstack sudo[104129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708
Jul 14 18:06:35 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:40 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708" returned: 0 in 5.649s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:40 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c125e2d3-07a7-4bc6-9dcf-add9f2f5a4c3]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:06:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:41 devstack sudo[104153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40
Jul 14 18:06:41 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:41 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40" returned: 0 in 0.656s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:41 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:06:41 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Converted 1024.00 MB image at 181.22 MB/s
Jul 14 18:06:41 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708 is being set with open permissions: ugo+rw
Jul 14 18:06:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:06:41 devstack sudo[104206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708
Jul 14 18:06:41 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:06:41 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root
Jul 14 18:06:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708" returned: 0 in 0.295s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:06:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Lock "cinder-quobyte-6a2a1c9a-165b-4cb4-9d20-b007da269708" released by "_copy_volume_from_snapshot" :: held 7.444s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:06:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Lock "cinder-quobyte-ff5aebb1-f874-4230-b112-a1b0dbdffd44-6a2a1c9a-165b-4cb4-9d20-b007da269708" released by "_create_volume_from_snapshot" :: held 7.477s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:06:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.496s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:06:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc77221c-8582-4073-8d81-7f2941abfcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2a1c9a-165b-4cb4-9d20-b007da269708', 'volume_size': 1, 'snapshot_id': 'ff5aebb1-f874-4230-b112-a1b0dbdffd44'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:06:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8204f3-f0d5-44b3-b505-177ceb00013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:06:41 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Volume volume-6a2a1c9a-165b-4cb4-9d20-b007da269708 (6a2a1c9a-165b-4cb4-9d20-b007da269708): created successfully
Jul 14 18:06:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8204f3-f0d5-44b3-b505-177ceb00013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:06:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Flow 'volume_create_manager' (966126fe-99ac-4473-bf66-fb5eb9a2a837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:06:41 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fc3d2060-2fb5-432f-ac01-e441d3fa6cdd tempest-TestStampPattern-1411497321 None] Created volume successfully.
Jul 14 18:06:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:06:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:07:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:07:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:20 devstack sudo[104294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:07:20 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:21 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.249s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:07:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:07:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:07:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:07:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5e69663a-02c8-4701-aba4-a6e3424967be req-5d7e54dd-20b2-46bc-a859-e1b38a136430 tempest-TestStampPattern-1411497321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5e69663a-02c8-4701-aba4-a6e3424967be req-5d7e54dd-20b2-46bc-a859-e1b38a136430 tempest-TestStampPattern-1411497321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[505df095-28e0-470e-8aca-d487533e8cb2]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:07:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5e69663a-02c8-4701-aba4-a6e3424967be req-5d7e54dd-20b2-46bc-a859-e1b38a136430 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:24 devstack sudo[104314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708
Jul 14 18:07:24 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:24 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [req-5e69663a-02c8-4701-aba4-a6e3424967be req-5d7e54dd-20b2-46bc-a859-e1b38a136430 tempest-TestStampPattern-1411497321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708" returned: 0 in 0.379s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [req-5e69663a-02c8-4701-aba4-a6e3424967be req-5d7e54dd-20b2-46bc-a859-e1b38a136430 tempest-TestStampPattern-1411497321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.398s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-5e69663a-02c8-4701-aba4-a6e3424967be req-5d7e54dd-20b2-46bc-a859-e1b38a136430 tempest-TestStampPattern-1411497321 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b', 'name': 'volume-6a2a1c9a-165b-4cb4-9d20-b007da269708', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18d2a052-d575-4feb-9c2c-29bf1364a661', 'enforce_multipath': True} {{(pid=87401) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 18:07:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-5e69663a-02c8-4701-aba4-a6e3424967be req-5d7e54dd-20b2-46bc-a859-e1b38a136430 tempest-TestStampPattern-1411497321 None] attachment_update completed successfully.
Jul 14 18:07:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [req-b47a29ab-c7cb-4188-96c1-ed57c545a773 req-c8b3a620-092f-433f-b53c-63384b65ea21 tempest-TestStampPattern-1411497321 None] Terminate volume connection completed successfully.
Jul 14 18:07:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [req-b47a29ab-c7cb-4188-96c1-ed57c545a773 req-c8b3a620-092f-433f-b53c-63384b65ea21 tempest-TestStampPattern-1411497321 None] Deleting attachment 18d2a052-d575-4feb-9c2c-29bf1364a661. {{(pid=87401) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 18:07:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Acquiring lock "cinder-6a2a1c9a-165b-4cb4-9d20-b007da269708-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Lock "cinder-6a2a1c9a-165b-4cb4-9d20-b007da269708-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Acquiring lock "cinder-quobyte-6a2a1c9a-165b-4cb4-9d20-b007da269708" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Lock "cinder-quobyte-6a2a1c9a-165b-4cb4-9d20-b007da269708" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fcaf19-cea3-4da2-b463-17939d57b6d6]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:07:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:31 devstack sudo[104771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708
Jul 14 18:07:31 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:31 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708" returned: 0 in 0.361s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:31 devstack sudo[104778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708
Jul 14 18:07:31 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:32 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6a2a1c9a-165b-4cb4-9d20-b007da269708" returned: 0 in 0.242s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Lock "cinder-quobyte-6a2a1c9a-165b-4cb4-9d20-b007da269708" released by "delete_volume" :: held 0.641s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Created reservations ['c4d7dad3-5dd4-4845-af38-c23daceaf6e4', 'd8f4153c-3254-489b-9370-9146426a5211', 'c52b70fd-27d7-434b-9122-2181f4a4c678', 'd354a686-f6b9-46a2-b0de-670ff4f49424'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:32 devstack sudo[104781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:07:32 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:32 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:07:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Deleted volume successfully.
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d88d633a-335e-4754-b844-d9c8191d7fcf tempest-TestStampPattern-1411497321 None] Lock "cinder-6a2a1c9a-165b-4cb4-9d20-b007da269708-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Acquiring lock "cinder-ff5aebb1-f874-4230-b112-a1b0dbdffd44-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Lock "cinder-ff5aebb1-f874-4230-b112-a1b0dbdffd44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Acquiring lock "cinder-quobyte-9d2576d8-4d0f-42b1-8472-ce634de05c40" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Lock "cinder-quobyte-9d2576d8-4d0f-42b1-8472-ce634de05c40" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Acquiring lock "cinder-quobyte-ff5aebb1-f874-4230-b112-a1b0dbdffd44" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Lock "cinder-quobyte-ff5aebb1-f874-4230-b112-a1b0dbdffd44" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Deleting offline snapshot ff5aebb1-f874-4230-b112-a1b0dbdffd44 of volume 9d2576d8-4d0f-42b1-8472-ce634de05c40 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] snapshot_file for this snap is: volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[58262be5-eb14-4920-9866-0dc994bd549a]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:07:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:32 devstack sudo[104784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44
Jul 14 18:07:32 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:33 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d2576d8-4d0f-42b1-8472-ce634de05c40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:07:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e93922-d3c9-4949-a361-5444f6a3ff12]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:07:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:33 devstack sudo[104789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40
Jul 14 18:07:33 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:33 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40" returned: 0 in 0.335s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:33 devstack sudo[104794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44
Jul 14 18:07:33 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:33 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44" returned: 0 in 0.330s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:33 devstack sudo[104800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44
Jul 14 18:07:33 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:34 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40.ff5aebb1-f874-4230-b112-a1b0dbdffd44" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Lock "cinder-quobyte-ff5aebb1-f874-4230-b112-a1b0dbdffd44" released by "_delete_snapshot" :: held 1.337s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Lock "cinder-quobyte-9d2576d8-4d0f-42b1-8472-ce634de05c40" released by "delete_snapshot" :: held 1.357s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:34 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Created reservations ['d5b5e4ef-63a2-438b-97d0-6edb33428881', '0b7978de-f4a6-41ec-b493-c5120f49e75d', '977a174b-998f-406a-b4d5-e7576ebd5b05', '78dd9c24-f9cf-4869-ae9a-b7ab4fdbd724'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:07:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Delete snapshot completed successfully.
Jul 14 18:07:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-04f33118-a910-429e-92de-62144b55a678 tempest-TestStampPattern-1411497321 None] Lock "cinder-ff5aebb1-f874-4230-b112-a1b0dbdffd44-delete_snapshot" released by "delete_snapshot" :: held 1.480s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Acquiring lock "cinder-9d2576d8-4d0f-42b1-8472-ce634de05c40-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Lock "cinder-9d2576d8-4d0f-42b1-8472-ce634de05c40-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Acquiring lock "cinder-quobyte-9d2576d8-4d0f-42b1-8472-ce634de05c40" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Lock "cinder-quobyte-9d2576d8-4d0f-42b1-8472-ce634de05c40" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dea3f75-6772-48fe-8ce7-53264b52c09e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:07:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:38 devstack sudo[104830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40
Jul 14 18:07:38 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:38 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:38 devstack sudo[104835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40
Jul 14 18:07:38 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:38 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-9d2576d8-4d0f-42b1-8472-ce634de05c40" returned: 0 in 0.233s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Lock "cinder-quobyte-9d2576d8-4d0f-42b1-8472-ce634de05c40" released by "delete_volume" :: held 0.640s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:39 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Created reservations ['e5f17f43-e4c7-4751-993c-a8734f4b689b', 'f5abb2a5-a387-4a26-9001-56c5e8993d65', 'd4a72b7d-fe77-4c53-8267-62b04612c9f4', 'c58b18e3-5cf3-4697-ad9b-4d09339a534b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:07:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:39 devstack sudo[104838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:07:39 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:39 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.228s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:39 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:07:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Deleted volume successfully.
Jul 14 18:07:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5e0c20ad-f61e-491b-8aec-9f928ddc1686 tempest-TestStampPattern-1411497321 None] Lock "cinder-9d2576d8-4d0f-42b1-8472-ce634de05c40-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=25,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Flow 'volume_create_manager' (ec46f6be-e206-4173-b9e4-819cafa6c1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8f667e-d492-4a0e-8220-a255a02bb601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8f667e-d492-4a0e-8220-a255a02bb601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-279227359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caac3c71-a961-4282-825a-d1a1eb305659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad58aea4eb204e4d83108c4255886e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:07:49Z,use_quota=True,user_id='15ffa10969d14f0492512747faad2b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a839b4-4dfb-4d9b-b881-801e9bbbeba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a839b4-4dfb-4d9b-b881-801e9bbbeba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abe2414-6727-4b64-820a-73306683510c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abe2414-6727-4b64-820a-73306683510c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caac3c71-a961-4282-825a-d1a1eb305659', 'volume_name': 'volume-caac3c71-a961-4282-825a-d1a1eb305659', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d9c04c-d406-43f3-88d9-f339192ee038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d9c04c-d406-43f3-88d9-f339192ee038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78aaa64-5ea2-4451-bb6c-77099cfb1c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Volume caac3c71-a961-4282-825a-d1a1eb305659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caac3c71-a961-4282-825a-d1a1eb305659', 'volume_size': 1}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-279227359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caac3c71-a961-4282-825a-d1a1eb305659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad58aea4eb204e4d83108c4255886e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:07:49Z,use_quota=True,user_id='15ffa10969d14f0492512747faad2b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Creating volume caac3c71-a961-4282-825a-d1a1eb305659 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:07:49 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-caac3c71-a961-4282-825a-d1a1eb305659 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:49 devstack sudo[104883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-caac3c71-a961-4282-825a-d1a1eb305659 1073741824
Jul 14 18:07:49 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Flow 'volume_create_manager' (ea04f59f-4528-49b3-b6ad-c554dee9f4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e32fe78-3754-49de-a7dc-692c08b7bdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e32fe78-3754-49de-a7dc-692c08b7bdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-282743016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0380d664-9093-41a2-8bff-dcba5b6d9ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad58aea4eb204e4d83108c4255886e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:07:49Z,use_quota=True,user_id='15ffa10969d14f0492512747faad2b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619ea850-ba63-4cd2-8b3a-45bc38dd18b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619ea850-ba63-4cd2-8b3a-45bc38dd18b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfbe10c-b975-44c0-ab6d-e22e5e9e43c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfbe10c-b975-44c0-ab6d-e22e5e9e43c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0380d664-9093-41a2-8bff-dcba5b6d9ef1', 'volume_name': 'volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae865060-b418-47cf-b242-95094f4b0e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae865060-b418-47cf-b242-95094f4b0e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7453998b-4a94-4e59-9c70-ff5daa607953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Volume 0380d664-9093-41a2-8bff-dcba5b6d9ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1', 'volume_size': 1}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:49 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-caac3c71-a961-4282-825a-d1a1eb305659 1073741824" returned: 0 in 0.499s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-caac3c71-a961-4282-825a-d1a1eb305659 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:49 devstack sudo[104890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-caac3c71-a961-4282-825a-d1a1eb305659
Jul 14 18:07:49 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Flow 'volume_create_manager' (283727f5-53d6-4ec0-bd76-8224c150e031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cec8194-8d96-4e61-aba3-f237a2d742ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cec8194-8d96-4e61-aba3-f237a2d742ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2018868988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a43a8e-74ce-41b5-8c06-9689264fdb27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad58aea4eb204e4d83108c4255886e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:07:50Z,use_quota=True,user_id='15ffa10969d14f0492512747faad2b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb317ef-17bc-4ac7-82cc-e8abe0274c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb317ef-17bc-4ac7-82cc-e8abe0274c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ea2e39-54ff-4b15-ad15-6b77eb6c0cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ea2e39-54ff-4b15-ad15-6b77eb6c0cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a43a8e-74ce-41b5-8c06-9689264fdb27', 'volume_name': 'volume-55a43a8e-74ce-41b5-8c06-9689264fdb27', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2669e3a2-799b-4e14-a16d-c0ac6e030266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2669e3a2-799b-4e14-a16d-c0ac6e030266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12143b4a-89bd-4a2c-aff7-e56004b5ab1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:49 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Volume 55a43a8e-74ce-41b5-8c06-9689264fdb27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a43a8e-74ce-41b5-8c06-9689264fdb27', 'volume_size': 1}
Jul 14 18:07:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:50 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-caac3c71-a961-4282-825a-d1a1eb305659" returned: 0 in 0.279s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-282743016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0380d664-9093-41a2-8bff-dcba5b6d9ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad58aea4eb204e4d83108c4255886e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:07:49Z,use_quota=True,user_id='15ffa10969d14f0492512747faad2b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Creating volume 0380d664-9093-41a2-8bff-dcba5b6d9ef1 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:07:50 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78aaa64-5ea2-4451-bb6c-77099cfb1c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caac3c71-a961-4282-825a-d1a1eb305659', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce61bdb-2517-43ff-994a-1297c277b973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:50 devstack sudo[104893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1 1073741824
Jul 14 18:07:50 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Volume volume-caac3c71-a961-4282-825a-d1a1eb305659 (caac3c71-a961-4282-825a-d1a1eb305659): created successfully
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce61bdb-2517-43ff-994a-1297c277b973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Flow 'volume_create_manager' (ec46f6be-e206-4173-b9e4-819cafa6c1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:07:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2e603222-677b-4197-b455-066a4911a79a tempest-CreateVolumesFromImageTest-1761905444 None] Created volume successfully.
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Flow 'volume_create_manager' (86d6a70b-3de8-4df3-9279-3694a72b94bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6cf8cd-96ff-49a3-bc36-5c1e2d37cf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6cf8cd-96ff-49a3-bc36-5c1e2d37cf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1889858499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df59c490-3a2e-4ed6-8e11-8d995fc3612b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad58aea4eb204e4d83108c4255886e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:07:50Z,use_quota=True,user_id='15ffa10969d14f0492512747faad2b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976c6f25-4c96-4baf-9e7b-1a26357ae881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976c6f25-4c96-4baf-9e7b-1a26357ae881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06f9c2a-9f07-4ac0-b674-5055f22de3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06f9c2a-9f07-4ac0-b674-5055f22de3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df59c490-3a2e-4ed6-8e11-8d995fc3612b', 'volume_name': 'volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1700f09f-65b0-4368-8cea-bd391340ef4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1700f09f-65b0-4368-8cea-bd391340ef4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f295bcb9-4dbc-428d-a139-f14123043a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Volume df59c490-3a2e-4ed6-8e11-8d995fc3612b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b', 'volume_size': 1}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:07:50 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Flow 'volume_create_manager' (fc8200d5-5c7e-4ef2-bb0d-013b63818de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1177abd4-7ff1-4368-85dd-e8c7292daf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1 1073741824" returned: 0 in 0.509s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1177abd4-7ff1-4368-85dd-e8c7292daf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-43734479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c439f072-980a-48ca-b850-379d04b2f4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad58aea4eb204e4d83108c4255886e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:07:51Z,use_quota=True,user_id='15ffa10969d14f0492512747faad2b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fa20de-1ecc-45e2-b32e-8b3e231c22a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fa20de-1ecc-45e2-b32e-8b3e231c22a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695bc843-7d17-4bcf-995d-96161417905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695bc843-7d17-4bcf-995d-96161417905d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c439f072-980a-48ca-b850-379d04b2f4af', 'volume_name': 'volume-c439f072-980a-48ca-b850-379d04b2f4af', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adbb693-2b92-4585-9ea6-9ffb319e80e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adbb693-2b92-4585-9ea6-9ffb319e80e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4411d0fa-619e-4e7b-a5a3-0c5726cbae07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Volume c439f072-980a-48ca-b850-379d04b2f4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c439f072-980a-48ca-b850-379d04b2f4af', 'volume_size': 1}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:50 devstack sudo[104899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1
Jul 14 18:07:50 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:50 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.989s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2018868988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a43a8e-74ce-41b5-8c06-9689264fdb27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad58aea4eb204e4d83108c4255886e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:07:50Z,use_quota=True,user_id='15ffa10969d14f0492512747faad2b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Creating volume 55a43a8e-74ce-41b5-8c06-9689264fdb27 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:07:50 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-55a43a8e-74ce-41b5-8c06-9689264fdb27 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7453998b-4a94-4e59-9c70-ff5daa607953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:50 devstack sudo[104902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-55a43a8e-74ce-41b5-8c06-9689264fdb27 1073741824
Jul 14 18:07:50 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243dc5b1-e1c6-4a4c-95ab-133756e904d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Volume volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1 (0380d664-9093-41a2-8bff-dcba5b6d9ef1): created successfully
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243dc5b1-e1c6-4a4c-95ab-133756e904d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Flow 'volume_create_manager' (ea04f59f-4528-49b3-b6ad-c554dee9f4b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:07:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a99d7ea9-d804-4824-bf33-2ff4e07c1a6e tempest-CreateVolumesFromImageTest-1761905444 None] Created volume successfully.
Jul 14 18:07:51 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-55a43a8e-74ce-41b5-8c06-9689264fdb27 1073741824" returned: 0 in 0.426s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-55a43a8e-74ce-41b5-8c06-9689264fdb27 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:51 devstack sudo[104907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-55a43a8e-74ce-41b5-8c06-9689264fdb27
Jul 14 18:07:51 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:51 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-55a43a8e-74ce-41b5-8c06-9689264fdb27" returned: 0 in 0.251s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.351s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1889858499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df59c490-3a2e-4ed6-8e11-8d995fc3612b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad58aea4eb204e4d83108c4255886e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:07:50Z,use_quota=True,user_id='15ffa10969d14f0492512747faad2b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Creating volume df59c490-3a2e-4ed6-8e11-8d995fc3612b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:07:51 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:51 devstack sudo[104910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b 1073741824
Jul 14 18:07:51 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12143b4a-89bd-4a2c-aff7-e56004b5ab1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a43a8e-74ce-41b5-8c06-9689264fdb27', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e562f0-ffea-4bd6-ae71-e40b9e20af31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:51 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Volume volume-55a43a8e-74ce-41b5-8c06-9689264fdb27 (55a43a8e-74ce-41b5-8c06-9689264fdb27): created successfully
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e562f0-ffea-4bd6-ae71-e40b9e20af31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:51 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Flow 'volume_create_manager' (283727f5-53d6-4ec0-bd76-8224c150e031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:07:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a4fe7897-ca5a-4d75-b410-6eb4b9a1b676 tempest-CreateVolumesFromImageTest-1761905444 None] Created volume successfully.
Jul 14 18:07:52 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b 1073741824" returned: 0 in 0.418s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:52 devstack sudo[104915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b
Jul 14 18:07:52 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:52 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b" returned: 0 in 0.252s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.714s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-43734479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c439f072-980a-48ca-b850-379d04b2f4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad58aea4eb204e4d83108c4255886e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:07:51Z,use_quota=True,user_id='15ffa10969d14f0492512747faad2b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Creating volume c439f072-980a-48ca-b850-379d04b2f4af {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:07:52 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c439f072-980a-48ca-b850-379d04b2f4af 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f295bcb9-4dbc-428d-a139-f14123043a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:52 devstack sudo[104918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c439f072-980a-48ca-b850-379d04b2f4af 1073741824
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c87e3b-3c1d-41ae-a761-517478690c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:52 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:52 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Volume volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b (df59c490-3a2e-4ed6-8e11-8d995fc3612b): created successfully
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c87e3b-3c1d-41ae-a761-517478690c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Flow 'volume_create_manager' (86d6a70b-3de8-4df3-9279-3694a72b94bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:07:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8a82c2e7-84cc-495e-a856-919a4c9949ba tempest-CreateVolumesFromImageTest-1761905444 None] Created volume successfully.
Jul 14 18:07:52 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c439f072-980a-48ca-b850-379d04b2f4af 1073741824" returned: 0 in 0.449s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c439f072-980a-48ca-b850-379d04b2f4af {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:52 devstack sudo[104924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c439f072-980a-48ca-b850-379d04b2f4af
Jul 14 18:07:52 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:53 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c439f072-980a-48ca-b850-379d04b2f4af" returned: 0 in 0.258s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:07:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4411d0fa-619e-4e7b-a5a3-0c5726cbae07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c439f072-980a-48ca-b850-379d04b2f4af', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bdb350-bbe1-410c-bf4f-2347050c5e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:07:53 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Volume volume-c439f072-980a-48ca-b850-379d04b2f4af (c439f072-980a-48ca-b850-379d04b2f4af): created successfully
Jul 14 18:07:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bdb350-bbe1-410c-bf4f-2347050c5e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:07:53 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Flow 'volume_create_manager' (fc8200d5-5c7e-4ef2-bb0d-013b63818de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:07:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a62a8ebb-b1aa-462e-8e92-c20206ba4abd tempest-CreateVolumesFromImageTest-1761905444 None] Created volume successfully.
Jul 14 18:07:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "cinder-c439f072-980a-48ca-b850-379d04b2f4af-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-c439f072-980a-48ca-b850-379d04b2f4af-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "cinder-quobyte-c439f072-980a-48ca-b850-379d04b2f4af" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-quobyte-c439f072-980a-48ca-b850-379d04b2f4af" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[456f4d37-a969-42b6-bba9-a106703a2d5c]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c439f072-980a-48ca-b850-379d04b2f4af {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:54 devstack sudo[104927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c439f072-980a-48ca-b850-379d04b2f4af
Jul 14 18:07:54 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:54 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c439f072-980a-48ca-b850-379d04b2f4af" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c439f072-980a-48ca-b850-379d04b2f4af {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:54 devstack sudo[104932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c439f072-980a-48ca-b850-379d04b2f4af
Jul 14 18:07:54 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:54 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c439f072-980a-48ca-b850-379d04b2f4af" returned: 0 in 0.242s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-quobyte-c439f072-980a-48ca-b850-379d04b2f4af" released by "delete_volume" :: held 0.622s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Created reservations ['ecbf26cc-e847-4d05-9f36-194a63bc4cc2', 'be175318-2046-4969-8ce1-03f4e6a6b55d', 'db1a1e11-7141-431a-93b5-ceefddd0c278', '35665a7b-b5b1-4a88-9e43-8973e9291306'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:54 devstack sudo[104941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:07:54 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:54 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.242s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:54 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:07:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Deleted volume successfully.
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-734acb17-c63a-41f5-8aeb-38544e6fae95 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-c439f072-980a-48ca-b850-379d04b2f4af-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "cinder-df59c490-3a2e-4ed6-8e11-8d995fc3612b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-df59c490-3a2e-4ed6-8e11-8d995fc3612b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "cinder-quobyte-df59c490-3a2e-4ed6-8e11-8d995fc3612b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-quobyte-df59c490-3a2e-4ed6-8e11-8d995fc3612b" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1981e8ec-2dac-4057-82e0-475ba1920f00]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:55 devstack sudo[104944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b
Jul 14 18:07:55 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:55 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:55 devstack sudo[104949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b
Jul 14 18:07:55 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:55 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-df59c490-3a2e-4ed6-8e11-8d995fc3612b" returned: 0 in 0.234s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-quobyte-df59c490-3a2e-4ed6-8e11-8d995fc3612b" released by "delete_volume" :: held 0.611s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Created reservations ['d83f5510-a23c-41d3-85c8-635a6b7e7487', '22ee6b34-4457-4476-85d4-ba651304e481', '54caf65f-719f-4693-b568-303a779adf05', 'bd75226b-a309-4907-86e4-ca35acd9f316'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:55 devstack sudo[104952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:07:55 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:56 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.245s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:07:56 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Deleted volume successfully.
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-322d7959-dfe1-425b-b053-531ee70bfa9e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-df59c490-3a2e-4ed6-8e11-8d995fc3612b-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "cinder-55a43a8e-74ce-41b5-8c06-9689264fdb27-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-55a43a8e-74ce-41b5-8c06-9689264fdb27-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "cinder-quobyte-55a43a8e-74ce-41b5-8c06-9689264fdb27" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-quobyte-55a43a8e-74ce-41b5-8c06-9689264fdb27" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2f7a02-6b48-413f-b677-9caabcd96eff]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-55a43a8e-74ce-41b5-8c06-9689264fdb27 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:56 devstack sudo[104955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-55a43a8e-74ce-41b5-8c06-9689264fdb27
Jul 14 18:07:56 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:56 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-55a43a8e-74ce-41b5-8c06-9689264fdb27" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-55a43a8e-74ce-41b5-8c06-9689264fdb27 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:56 devstack sudo[104960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-55a43a8e-74ce-41b5-8c06-9689264fdb27
Jul 14 18:07:56 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:56 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-55a43a8e-74ce-41b5-8c06-9689264fdb27" returned: 0 in 0.237s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-quobyte-55a43a8e-74ce-41b5-8c06-9689264fdb27" released by "delete_volume" :: held 0.619s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:56 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Created reservations ['ff409e27-5bb9-4f62-bc84-8275c5bf1b4c', '4dbc2705-1d6f-4cf8-a2f0-f1c213454b32', 'ca38396e-8b0e-45e8-aa3c-8bd11c0cbbf8', 'afd99ff5-54a8-4b37-8e71-e61f142fccce'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:57 devstack sudo[104963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:07:57 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:57 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.238s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:07:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Deleted volume successfully.
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a1ed9269-6a65-4861-91ca-baf811d262ab tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-55a43a8e-74ce-41b5-8c06-9689264fdb27-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "cinder-0380d664-9093-41a2-8bff-dcba5b6d9ef1-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-0380d664-9093-41a2-8bff-dcba5b6d9ef1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "cinder-quobyte-0380d664-9093-41a2-8bff-dcba5b6d9ef1" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-quobyte-0380d664-9093-41a2-8bff-dcba5b6d9ef1" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a03775-ed46-466b-91d5-7cba9a207a2e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:57 devstack sudo[104968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1
Jul 14 18:07:57 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:57 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1" returned: 0 in 0.334s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:57 devstack sudo[104973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1
Jul 14 18:07:57 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:58 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-0380d664-9093-41a2-8bff-dcba5b6d9ef1" returned: 0 in 0.234s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-quobyte-0380d664-9093-41a2-8bff-dcba5b6d9ef1" released by "delete_volume" :: held 0.611s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Created reservations ['dcd6dece-d4d5-4ead-9c9c-a1654a7063ae', '41137eb1-6ecb-43f2-93e5-f016519c5be5', 'bf106961-59a9-48a9-916c-8c48147376ae', 'a3ab162f-9866-49ad-8851-55c89ca5e370'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:58 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:07:58 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:58 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.257s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:07:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Deleted volume successfully.
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-6a401d4f-8faf-42ac-a6e9-d98f4897b28e tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-0380d664-9093-41a2-8bff-dcba5b6d9ef1-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "cinder-caac3c71-a961-4282-825a-d1a1eb305659-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-caac3c71-a961-4282-825a-d1a1eb305659-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "cinder-quobyte-caac3c71-a961-4282-825a-d1a1eb305659" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-quobyte-caac3c71-a961-4282-825a-d1a1eb305659" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ec475d-9401-44b3-9c41-f662a68ee717]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:07:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-caac3c71-a961-4282-825a-d1a1eb305659 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:58 devstack sudo[104979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-caac3c71-a961-4282-825a-d1a1eb305659
Jul 14 18:07:58 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:59 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-caac3c71-a961-4282-825a-d1a1eb305659" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-caac3c71-a961-4282-825a-d1a1eb305659 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:59 devstack sudo[104984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-caac3c71-a961-4282-825a-d1a1eb305659
Jul 14 18:07:59 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:59 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-caac3c71-a961-4282-825a-d1a1eb305659" returned: 0 in 0.233s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-quobyte-caac3c71-a961-4282-825a-d1a1eb305659" released by "delete_volume" :: held 0.615s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Created reservations ['28f172cd-cef3-4b93-b810-c703e71135d4', '98d8cd47-9c0b-441c-bda5-825acf1be2c9', 'b27ef83e-380b-4a78-9236-2092caf05199', 'f6942f70-48a9-407b-bb56-3223f032b530'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:07:59 devstack sudo[104987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:07:59 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:07:59 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.226s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:07:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Deleted volume successfully.
Jul 14 18:07:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ab9e54b4-f658-401c-92e8-ac0a47a58213 tempest-CreateVolumesFromImageTest-1761905444 None] Lock "cinder-caac3c71-a961-4282-825a-d1a1eb305659-delete_volume" released by "delete_volume" :: held 1.021s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:08:09 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=60,cinder:SELECT=35,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:08:09 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=54,cinder:UPDATE=73,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:08:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:08:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:08:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:08:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:20 devstack sudo[104997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:08:20 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:21 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.275s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:08:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:08:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:08:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Flow 'volume_create_manager' (8a8fd285-0a57-46d8-87ae-5c425631155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab987c8d-5fb1-46cb-a20f-07c41f256aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab987c8d-5fb1-46cb-a20f-07c41f256aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1600613651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669ad26b-e2c8-443b-bba5-0678c4f2c5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0b3a10c0814fcdbe80f151b4e89c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:23Z,use_quota=True,user_id='3c3b454ec6124215b2668fddedb93815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0775b4e-9ece-43cb-809a-3efc29c65695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0775b4e-9ece-43cb-809a-3efc29c65695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110ba000-ab29-4a81-9032-b62f3bfea254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110ba000-ab29-4a81-9032-b62f3bfea254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '669ad26b-e2c8-443b-bba5-0678c4f2c5b9', 'volume_name': 'volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5095abf2-3d55-40c6-a47f-d080121ff9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5095abf2-3d55-40c6-a47f-d080121ff9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bf6393-b7ed-4cb1-b11a-a68c1918924f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Volume 669ad26b-e2c8-443b-bba5-0678c4f2c5b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9', 'volume_size': 1}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1600613651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669ad26b-e2c8-443b-bba5-0678c4f2c5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0b3a10c0814fcdbe80f151b4e89c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:23Z,use_quota=True,user_id='3c3b454ec6124215b2668fddedb93815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Creating volume 669ad26b-e2c8-443b-bba5-0678c4f2c5b9 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:08:23 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:08:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:23 devstack sudo[105000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 1073741824
Jul 14 18:08:23 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:24 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 1073741824" returned: 0 in 0.391s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:24 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9
Jul 14 18:08:24 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:24 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" returned: 0 in 0.230s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bf6393-b7ed-4cb1-b11a-a68c1918924f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396f8066-a923-4f57-b8cf-37dd35e916f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:24 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Volume volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 (669ad26b-e2c8-443b-bba5-0678c4f2c5b9): created successfully
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396f8066-a923-4f57-b8cf-37dd35e916f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Flow 'volume_create_manager' (8a8fd285-0a57-46d8-87ae-5c425631155d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-cd79121a-8be3-4f37-a37d-8f0a337a53f7 tempest-SnapshotDependencyTests-1910851241 None] Created volume successfully.
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] Creating offline snapshot 6b85e2f2-e939-45d7-af28-719a29dc177a of volume 669ad26b-e2c8-443b-bba5-0678c4f2c5b9 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd148aa-a96a-4624-acd7-48461e155923]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:08:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:24 devstack sudo[105008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9
Jul 14 18:08:24 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:25 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" returned: 0 in 0.339s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:25 devstack sudo[105013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a 1G
Jul 14 18:08:25 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:25 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a 1G" returned: 0 in 0.377s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:25 devstack sudo[105018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a
Jul 14 18:08:25 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:25 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:25 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a is being set with open permissions: ugo+rw
Jul 14 18:08:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:25 devstack sudo[105023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a
Jul 14 18:08:25 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:25 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a" returned: 0 in 0.228s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:26 devstack sudo[105026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.info
Jul 14 18:08:26 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:26 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.info" returned: 0 in 0.232s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:26 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.info is being set with open permissions: ugo+rw
Jul 14 18:08:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:26 devstack sudo[105029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.info
Jul 14 18:08:26 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:26 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.info" returned: 0 in 0.226s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.744s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f32fcbac-5b0d-4def-bd36-a849acab94be tempest-SnapshotDependencyTests-1910851241 None] Create snapshot completed successfully
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Flow 'volume_create_manager' (ace0e319-3bcf-492a-a240-e8243f4bd3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f096bbc-aa43-4ff1-b206-12692ded2af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f096bbc-aa43-4ff1-b206-12692ded2af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230faa79-7a93-4e80-bd02-31d351a00e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0b3a10c0814fcdbe80f151b4e89c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6b85e2f2-e939-45d7-af28-719a29dc177a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:27Z,use_quota=True,user_id='3c3b454ec6124215b2668fddedb93815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a76992-e1f7-4863-bfdd-c8c1224b749b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a76992-e1f7-4863-bfdd-c8c1224b749b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd33548-5f11-41da-81c3-59c1ba245b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd33548-5f11-41da-81c3-59c1ba245b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '230faa79-7a93-4e80-bd02-31d351a00e46', 'volume_name': 'volume-230faa79-7a93-4e80-bd02-31d351a00e46', 'volume_size': 1, 'snapshot_id': '6b85e2f2-e939-45d7-af28-719a29dc177a'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1892c7de-a0a5-45d9-b692-2dffd81f9cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1892c7de-a0a5-45d9-b692-2dffd81f9cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7d71b9-7b14-4294-9354-68fad0bdd2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:27 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Volume 230faa79-7a93-4e80-bd02-31d351a00e46: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-230faa79-7a93-4e80-bd02-31d351a00e46', 'volume_size': 1, 'snapshot_id': '6b85e2f2-e939-45d7-af28-719a29dc177a'}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "cinder-quobyte-6b85e2f2-e939-45d7-af28-719a29dc177a-230faa79-7a93-4e80-bd02-31d351a00e46" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-quobyte-6b85e2f2-e939-45d7-af28-719a29dc177a-230faa79-7a93-4e80-bd02-31d351a00e46" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Creating volume 230faa79-7a93-4e80-bd02-31d351a00e46 from snapshot 6b85e2f2-e939-45d7-af28-719a29dc177a {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "cinder-quobyte-230faa79-7a93-4e80-bd02-31d351a00e46" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-quobyte-230faa79-7a93-4e80-bd02-31d351a00e46" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] snapshot: 6b85e2f2-e939-45d7-af28-719a29dc177a, volume: 230faa79-7a93-4e80-bd02-31d351a00e46,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b997414-310f-432b-a617-0edd9d9a9b4e]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:27 devstack sudo[105032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a
Jul 14 18:08:27 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:27 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b50175e-9eaa-4721-8dc9-7f554f1d8d82]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:08:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:27 devstack sudo[105037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9
Jul 14 18:08:27 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:28 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" returned: 0 in 0.333s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:28 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Path /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 18:08:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:28 devstack sudo[105042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46
Jul 14 18:08:28 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:32 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46" returned: 0 in 3.859s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fd9159-671d-4f60-808a-da086665e4a8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:32 devstack sudo[105056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9
Jul 14 18:08:32 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:32 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" returned: 0 in 0.524s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9, size 1024.00 MB, duration 3.86 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:08:32 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Converted 1024.00 MB image at 265.23 MB/s
Jul 14 18:08:32 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46 is being set with open permissions: ugo+rw
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:32 devstack sudo[105061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46
Jul 14 18:08:32 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:32 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-quobyte-230faa79-7a93-4e80-bd02-31d351a00e46" released by "_copy_volume_from_snapshot" :: held 5.383s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-quobyte-6b85e2f2-e939-45d7-af28-719a29dc177a-230faa79-7a93-4e80-bd02-31d351a00e46" released by "_create_volume_from_snapshot" :: held 5.408s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.421s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7d71b9-7b14-4294-9354-68fad0bdd2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-230faa79-7a93-4e80-bd02-31d351a00e46', 'volume_size': 1, 'snapshot_id': '6b85e2f2-e939-45d7-af28-719a29dc177a'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88955437-9687-4629-b98d-648cd6dad312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:32 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Volume volume-230faa79-7a93-4e80-bd02-31d351a00e46 (230faa79-7a93-4e80-bd02-31d351a00e46): created successfully
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88955437-9687-4629-b98d-648cd6dad312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Flow 'volume_create_manager' (ace0e319-3bcf-492a-a240-e8243f4bd3b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7e1eebdc-6d60-4098-a4e8-78aee8243dc9 tempest-SnapshotDependencyTests-1910851241 None] Created volume successfully.
Jul 14 18:08:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "cinder-6b85e2f2-e939-45d7-af28-719a29dc177a-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:08:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-6b85e2f2-e939-45d7-af28-719a29dc177a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:08:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "cinder-quobyte-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:08:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-quobyte-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:08:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "cinder-quobyte-6b85e2f2-e939-45d7-af28-719a29dc177a" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:08:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-quobyte-6b85e2f2-e939-45d7-af28-719a29dc177a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:08:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Deleting offline snapshot 6b85e2f2-e939-45d7-af28-719a29dc177a of volume 669ad26b-e2c8-443b-bba5-0678c4f2c5b9 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:08:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] snapshot_file for this snap is: volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:08:33 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb36a8d-6b2b-47d5-b3b6-889d1caf4c43]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:08:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:34 devstack sudo[105064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a
Jul 14 18:08:34 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:34 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a" returned: 0 in 0.343s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:08:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc2fcc0-ca09-424b-bd9e-3af9a6bcbf4b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:08:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:34 devstack sudo[105069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9
Jul 14 18:08:34 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:34 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" returned: 0 in 0.347s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:34 devstack sudo[105074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a
Jul 14 18:08:34 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:35 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a" returned: 0 in 0.326s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:35 devstack sudo[105079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a
Jul 14 18:08:35 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:35 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9.6b85e2f2-e939-45d7-af28-719a29dc177a" returned: 0 in 0.232s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-quobyte-6b85e2f2-e939-45d7-af28-719a29dc177a" released by "_delete_snapshot" :: held 1.338s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:08:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-quobyte-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" released by "delete_snapshot" :: held 1.358s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:08:35 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Created reservations ['f3d238a9-24e0-44a4-a307-5e4224935db5', '02e9561a-285b-48ef-8448-fc74095fee06', 'e7d5ca28-2bc9-4e56-960b-9c60c1e98929', '4082b8fa-b532-417a-8416-91556f367cab'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:08:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Delete snapshot completed successfully.
Jul 14 18:08:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-83591fb8-1e8e-4165-bef2-056061dab936 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-6b85e2f2-e939-45d7-af28-719a29dc177a-delete_snapshot" released by "delete_snapshot" :: held 1.478s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "cinder-669ad26b-e2c8-443b-bba5-0678c4f2c5b9-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-669ad26b-e2c8-443b-bba5-0678c4f2c5b9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "cinder-quobyte-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-quobyte-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" acquired by "delete_volume" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc175791-5cfd-41e9-bbff-a21fc64f0aa4]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:36 devstack sudo[105082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9
Jul 14 18:08:36 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:36 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" returned: 0 in 0.352s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:36 devstack sudo[105087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9
Jul 14 18:08:36 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:36 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" returned: 0 in 0.229s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-quobyte-669ad26b-e2c8-443b-bba5-0678c4f2c5b9" released by "delete_volume" :: held 0.638s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Created reservations ['c22b60f2-6ffb-460e-b16e-f83a96dbd44c', '852bf571-9cf6-4ee5-a3ba-ace19ae2f5b8', '5b7297bf-0f9d-49ff-bd0b-47a499445c14', 'dff3311d-0ccf-4948-a766-fc4ac8754b7f'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:36 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:08:36 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:37 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.229s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:08:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Deleted volume successfully.
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a29d80b0-34a1-4030-9abc-fe3fd6427613 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-669ad26b-e2c8-443b-bba5-0678c4f2c5b9-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "cinder-230faa79-7a93-4e80-bd02-31d351a00e46-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-230faa79-7a93-4e80-bd02-31d351a00e46-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "cinder-quobyte-230faa79-7a93-4e80-bd02-31d351a00e46" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-quobyte-230faa79-7a93-4e80-bd02-31d351a00e46" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe8547f-e306-4195-ad69-3e568bd27c7f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:37 devstack sudo[105093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46
Jul 14 18:08:37 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:37 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46" returned: 0 in 0.348s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:37 devstack sudo[105098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46
Jul 14 18:08:37 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:37 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-230faa79-7a93-4e80-bd02-31d351a00e46" returned: 0 in 0.240s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-quobyte-230faa79-7a93-4e80-bd02-31d351a00e46" released by "delete_volume" :: held 0.625s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Created reservations ['e02f3a2e-c9ce-48bd-8d65-7a8c4c7f07a7', 'acf0ffaf-4c19-46a1-a9d0-c94d2afc304c', '2f793db2-0f3f-442a-92f4-9ac85e379f13', '24e81ab1-61be-44bf-ad30-328a0aa0bb96'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:38 devstack sudo[105101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:08:38 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:38 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.234s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:38 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:08:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Deleted volume successfully.
Jul 14 18:08:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-e82e50f6-abc5-4734-aa4a-b5496b692d81 tempest-SnapshotDependencyTests-1910851241 None] Lock "cinder-230faa79-7a93-4e80-bd02-31d351a00e46-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:08:48 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=25,cinder:UPDATE=20,cinder:INSERT=9,cinder:DELETE=5 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:08:53 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=23,cinder:UPDATE=37,cinder:INSERT=5 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Flow 'volume_create_manager' (2b82bd80-0101-4fbb-8d70-97244a619846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f24268f-4845-4e77-a67e-4b0b28b57762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f24268f-4845-4e77-a67e-4b0b28b57762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-665313613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a0ce97-357e-4112-b8d3-bb5fbf4a32c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d64385258d49b8908f2e2548a9d30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:57Z,use_quota=True,user_id='de52f9dff5374c9582addf42c1a78f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd501506-a57c-4b4d-ba9e-f2983904e825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd501506-a57c-4b4d-ba9e-f2983904e825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca183f17-cbaa-4c3e-b86d-84a85af20172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca183f17-cbaa-4c3e-b86d-84a85af20172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a0ce97-357e-4112-b8d3-bb5fbf4a32c5', 'volume_name': 'volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f258023b-9369-4aef-8bb8-bfd327b19207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f258023b-9369-4aef-8bb8-bfd327b19207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09473257-adc0-4a7c-ac20-2a0c44ab4e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume 15a0ce97-357e-4112-b8d3-bb5fbf4a32c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5', 'volume_size': 1}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-665313613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a0ce97-357e-4112-b8d3-bb5fbf4a32c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d64385258d49b8908f2e2548a9d30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:57Z,use_quota=True,user_id='de52f9dff5374c9582addf42c1a78f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Creating volume 15a0ce97-357e-4112-b8d3-bb5fbf4a32c5 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:08:57 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:08:57 devstack sudo[105190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5 1073741824
Jul 14 18:08:57 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Flow 'volume_create_manager' (5fae299a-454e-4a8e-afaf-44ad19496599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd93802-03cc-446c-9734-fa22a818d595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd93802-03cc-446c-9734-fa22a818d595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2137613602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad979f4c-b076-4526-9445-988efbdbbceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a1c6506e7c499ebe538ce0283cc86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:57Z,use_quota=True,user_id='afe637a33f2b4010812b8940e4c72add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803461d4-8170-405c-90bf-ef771872052c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803461d4-8170-405c-90bf-ef771872052c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9f06f6-578c-40e8-95a7-7ffca372e1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f9f06f6-578c-40e8-95a7-7ffca372e1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad979f4c-b076-4526-9445-988efbdbbceb', 'volume_name': 'volume-ad979f4c-b076-4526-9445-988efbdbbceb', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c98289-aa17-4752-9eba-15cb752a3fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c98289-aa17-4752-9eba-15cb752a3fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a92e91-38d3-43de-81ca-9430963e1ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Volume ad979f4c-b076-4526-9445-988efbdbbceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad979f4c-b076-4526-9445-988efbdbbceb', 'volume_size': 1}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Flow 'volume_create_manager' (98b0300c-24ed-4db1-a637-ed15d2726183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f679a6bd-e15a-44d1-afcb-b148352716b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f679a6bd-e15a-44d1-afcb-b148352716b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1802015051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9caad8-0bc9-4312-86f8-7632f831439e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a1c6506e7c499ebe538ce0283cc86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:57Z,use_quota=True,user_id='afe637a33f2b4010812b8940e4c72add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88931d42-6b8c-4af6-a302-120ab546dc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88931d42-6b8c-4af6-a302-120ab546dc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace1563d-e086-4a67-9dd5-d0f5e435a8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace1563d-e086-4a67-9dd5-d0f5e435a8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff9caad8-0bc9-4312-86f8-7632f831439e', 'volume_name': 'volume-ff9caad8-0bc9-4312-86f8-7632f831439e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3f6373-e489-481c-aef0-d3493c93614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3f6373-e489-481c-aef0-d3493c93614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3834e3f-d56d-467e-99bc-9bb7a8cd5b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:57 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Volume ff9caad8-0bc9-4312-86f8-7632f831439e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff9caad8-0bc9-4312-86f8-7632f831439e', 'volume_size': 1}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:57 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5 1073741824" returned: 0 in 0.614s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:57 devstack sudo[105196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5
Jul 14 18:08:57 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Flow 'volume_create_manager' (f9da6b96-3016-46d0-93ac-71e2813547b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af64afa-2b1f-4997-82f2-2aa28dd3cce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af64afa-2b1f-4997-82f2-2aa28dd3cce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1578947001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6824c03a-919a-423f-8ca0-dc5d9bf5a831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a1c6506e7c499ebe538ce0283cc86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:58Z,use_quota=True,user_id='afe637a33f2b4010812b8940e4c72add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12dcdc42-4dab-4431-ad60-34645fbf26a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12dcdc42-4dab-4431-ad60-34645fbf26a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf0b053-3956-4290-a0c1-a6e260d984ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf0b053-3956-4290-a0c1-a6e260d984ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6824c03a-919a-423f-8ca0-dc5d9bf5a831', 'volume_name': 'volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec809fc-080a-4320-8673-4cf9861316a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec809fc-080a-4320-8673-4cf9861316a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965efef5-9627-4ec7-b4b7-22f080ad257a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Volume 6824c03a-919a-423f-8ca0-dc5d9bf5a831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831', 'volume_size': 1}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:58 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5" returned: 0 in 0.430s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2137613602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad979f4c-b076-4526-9445-988efbdbbceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a1c6506e7c499ebe538ce0283cc86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:57Z,use_quota=True,user_id='afe637a33f2b4010812b8940e4c72add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Creating volume ad979f4c-b076-4526-9445-988efbdbbceb {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:08:58 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ad979f4c-b076-4526-9445-988efbdbbceb 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09473257-adc0-4a7c-ac20-2a0c44ab4e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb6d47e-bb57-4ec8-8e75-045c619f0904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:58 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ad979f4c-b076-4526-9445-988efbdbbceb 1073741824
Jul 14 18:08:58 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5 (15a0ce97-357e-4112-b8d3-bb5fbf4a32c5): created successfully
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb6d47e-bb57-4ec8-8e75-045c619f0904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Flow 'volume_create_manager' (2b82bd80-0101-4fbb-8d70-97244a619846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:58 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e68a80ee-5b01-4f1b-ad4b-5b0f6134554a tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Created volume successfully.
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Flow 'volume_create_manager' (dac435d2-1c42-4f15-ba17-750f38759f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b995036e-1ce2-4b05-9371-e29a042f3f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b995036e-1ce2-4b05-9371-e29a042f3f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1925933919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62075715-28f8-4e64-aef4-2f0b7cce8fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a1c6506e7c499ebe538ce0283cc86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:59Z,use_quota=True,user_id='afe637a33f2b4010812b8940e4c72add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c115e55-2cf0-4971-897e-c878a399ad75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c115e55-2cf0-4971-897e-c878a399ad75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced3fb7a-d88f-46e9-b5fd-5c9df355fbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced3fb7a-d88f-46e9-b5fd-5c9df355fbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62075715-28f8-4e64-aef4-2f0b7cce8fdc', 'volume_name': 'volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870e1c3a-53c2-4f20-bc87-7f288fb60be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870e1c3a-53c2-4f20-bc87-7f288fb60be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3563ab7-dece-4f6b-9415-77a2ce4560db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Volume 62075715-28f8-4e64-aef4-2f0b7cce8fdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc', 'volume_size': 1}
Jul 14 18:08:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:59 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ad979f4c-b076-4526-9445-988efbdbbceb 1073741824" returned: 0 in 0.767s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Flow 'volume_create_manager' (bb020964-8dc9-495b-8b8d-5331eb848ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b690f7d3-7fb2-4db0-8af6-ea7ccb7155b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b690f7d3-7fb2-4db0-8af6-ea7ccb7155b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1719050650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9247c4b-a22e-4d2e-af8e-2e62a281f8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a1c6506e7c499ebe538ce0283cc86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:59Z,use_quota=True,user_id='afe637a33f2b4010812b8940e4c72add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18df0171-0c90-4a95-8f79-263f205b02fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18df0171-0c90-4a95-8f79-263f205b02fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07db3ddd-9a8c-4cd7-8cab-ee85d2a1e1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07db3ddd-9a8c-4cd7-8cab-ee85d2a1e1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9247c4b-a22e-4d2e-af8e-2e62a281f8e2', 'volume_name': 'volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803b3adf-3aee-4bc7-9c4b-618b2e95e0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803b3adf-3aee-4bc7-9c4b-618b2e95e0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c4ca19-6d44-487f-ab21-083fe885c559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Volume a9247c4b-a22e-4d2e-af8e-2e62a281f8e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2', 'volume_size': 1}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ad979f4c-b076-4526-9445-988efbdbbceb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:59 devstack sudo[105206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ad979f4c-b076-4526-9445-988efbdbbceb
Jul 14 18:08:59 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:59 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ad979f4c-b076-4526-9445-988efbdbbceb" returned: 0 in 0.388s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.984s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1802015051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9caad8-0bc9-4312-86f8-7632f831439e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a1c6506e7c499ebe538ce0283cc86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:57Z,use_quota=True,user_id='afe637a33f2b4010812b8940e4c72add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Creating volume ff9caad8-0bc9-4312-86f8-7632f831439e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:08:59 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ff9caad8-0bc9-4312-86f8-7632f831439e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:08:59 devstack sudo[105209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ff9caad8-0bc9-4312-86f8-7632f831439e 1073741824
Jul 14 18:08:59 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a92e91-38d3-43de-81ca-9430963e1ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad979f4c-b076-4526-9445-988efbdbbceb', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a92050e3-571e-413d-bdd5-7466c25946d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Flow 'volume_create_manager' (89faab41-8034-4ef0-8dbd-ad6124da20a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b8843d-073e-459e-95bc-c900c0c4fbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Volume volume-ad979f4c-b076-4526-9445-988efbdbbceb (ad979f4c-b076-4526-9445-988efbdbbceb): created successfully
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a92050e3-571e-413d-bdd5-7466c25946d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Flow 'volume_create_manager' (5fae299a-454e-4a8e-afaf-44ad19496599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b8843d-073e-459e-95bc-c900c0c4fbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2101703306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e307cf-d671-4650-b3a4-0930e01d7600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d64385258d49b8908f2e2548a9d30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:00Z,use_quota=True,user_id='de52f9dff5374c9582addf42c1a78f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9172a46-d0fe-43ac-8af7-150c84665714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9172a46-d0fe-43ac-8af7-150c84665714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794eef5a-2e1e-42de-9f23-44edc7b6ed2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794eef5a-2e1e-42de-9f23-44edc7b6ed2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e307cf-d671-4650-b3a4-0930e01d7600', 'volume_name': 'volume-54e307cf-d671-4650-b3a4-0930e01d7600', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b152068d-0eb7-492a-8c23-e84c12055bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b152068d-0eb7-492a-8c23-e84c12055bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff04a115-2eaa-4727-9ba3-00e7ccd843f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:08:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume 54e307cf-d671-4650-b3a4-0930e01d7600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e307cf-d671-4650-b3a4-0930e01d7600', 'volume_size': 1}
Jul 14 18:08:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:08:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-18d4dbf8-2c69-4fac-824a-1793f04a30e3 tempest-CreateVolumesFromImageTest-2038004719 None] Created volume successfully.
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Flow 'volume_create_manager' (766ea92c-0e51-4d25-84f6-6c5523494ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac38da29-b47e-4139-88c6-1e8e1a659e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac38da29-b47e-4139-88c6-1e8e1a659e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1542412384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00ec01b-50a0-440d-94ff-126d70e6b632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d64385258d49b8908f2e2548a9d30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:00Z,use_quota=True,user_id='de52f9dff5374c9582addf42c1a78f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9da2770-84ce-41ea-9371-e2d1e66473c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9da2770-84ce-41ea-9371-e2d1e66473c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:00 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc874dec-4749-41b7-856a-ae4e49e4e7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc874dec-4749-41b7-856a-ae4e49e4e7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a00ec01b-50a0-440d-94ff-126d70e6b632', 'volume_name': 'volume-a00ec01b-50a0-440d-94ff-126d70e6b632', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478d6043-3d4f-4682-9a2b-62d602de6678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478d6043-3d4f-4682-9a2b-62d602de6678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a12cbc2-bd60-42da-99d4-fd7b92c2aea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume a00ec01b-50a0-440d-94ff-126d70e6b632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a00ec01b-50a0-440d-94ff-126d70e6b632', 'volume_size': 1}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ff9caad8-0bc9-4312-86f8-7632f831439e 1073741824" returned: 0 in 0.845s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ff9caad8-0bc9-4312-86f8-7632f831439e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:00 devstack sudo[105215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ff9caad8-0bc9-4312-86f8-7632f831439e
Jul 14 18:09:00 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:00 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ff9caad8-0bc9-4312-86f8-7632f831439e" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.718s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1578947001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6824c03a-919a-423f-8ca0-dc5d9bf5a831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a1c6506e7c499ebe538ce0283cc86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:58Z,use_quota=True,user_id='afe637a33f2b4010812b8940e4c72add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Creating volume 6824c03a-919a-423f-8ca0-dc5d9bf5a831 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:00 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:00 devstack sudo[105218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831 1073741824
Jul 14 18:09:00 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3834e3f-d56d-467e-99bc-9bb7a8cd5b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff9caad8-0bc9-4312-86f8-7632f831439e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42c121c-b757-47fe-94a3-b236a56e7c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Volume volume-ff9caad8-0bc9-4312-86f8-7632f831439e (ff9caad8-0bc9-4312-86f8-7632f831439e): created successfully
Jul 14 18:09:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42c121c-b757-47fe-94a3-b236a56e7c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Flow 'volume_create_manager' (98b0300c-24ed-4db1-a637-ed15d2726183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Flow 'volume_create_manager' (3853171a-2cc3-4ab2-93dd-de5d715667ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce5eca0-f9ac-4e70-980e-c3734a1e2f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-309cb6a3-1712-4f93-9fb5-45280eda31de tempest-CreateVolumesFromImageTest-2038004719 None] Created volume successfully.
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce5eca0-f9ac-4e70-980e-c3734a1e2f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1549804835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd45a8c-3524-426d-b0d4-10ee9783a82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d64385258d49b8908f2e2548a9d30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:01Z,use_quota=True,user_id='de52f9dff5374c9582addf42c1a78f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92123ee-baf0-4207-9502-1cf422090362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92123ee-baf0-4207-9502-1cf422090362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4f7ee5-fb48-434c-96bf-5fbc618eec1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4f7ee5-fb48-434c-96bf-5fbc618eec1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd45a8c-3524-426d-b0d4-10ee9783a82c', 'volume_name': 'volume-afd45a8c-3524-426d-b0d4-10ee9783a82c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23c2b97-fff3-4083-9c38-ff392e228c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23c2b97-fff3-4083-9c38-ff392e228c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06464841-c0c0-4ea8-806a-e85636d32c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume afd45a8c-3524-426d-b0d4-10ee9783a82c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd45a8c-3524-426d-b0d4-10ee9783a82c', 'volume_size': 1}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:01 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831 1073741824" returned: 0 in 0.744s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:01 devstack sudo[105224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831
Jul 14 18:09:01 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Flow 'volume_create_manager' (6720d9d5-fada-47b4-8367-d3d418a263ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd1b0d8-8804-4ea2-9eb9-129fc1a6188a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd1b0d8-8804-4ea2-9eb9-129fc1a6188a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1798170742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fbee33-3874-4a45-892d-57fc6d23d748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d64385258d49b8908f2e2548a9d30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:02Z,use_quota=True,user_id='de52f9dff5374c9582addf42c1a78f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e36209-303f-4d10-8cf8-a0e98f22b0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e36209-303f-4d10-8cf8-a0e98f22b0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940b658d-a9ca-462a-a8d8-7390928c938f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940b658d-a9ca-462a-a8d8-7390928c938f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27fbee33-3874-4a45-892d-57fc6d23d748', 'volume_name': 'volume-27fbee33-3874-4a45-892d-57fc6d23d748', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dc1cbc-f9bc-49bf-9bcd-066a42bc710f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dc1cbc-f9bc-49bf-9bcd-066a42bc710f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0059185a-838d-41bf-9918-181b25844813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume 27fbee33-3874-4a45-892d-57fc6d23d748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27fbee33-3874-4a45-892d-57fc6d23d748', 'volume_size': 1}
Jul 14 18:09:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:02 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Flow 'volume_create_manager' (c60af0f8-e7f6-4a2b-9447-abfbc5c9be03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3793bb24-16ea-41e8-8dc5-1505e27b4a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831" returned: 0 in 0.362s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.373s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1925933919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62075715-28f8-4e64-aef4-2f0b7cce8fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a1c6506e7c499ebe538ce0283cc86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:59Z,use_quota=True,user_id='afe637a33f2b4010812b8940e4c72add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Creating volume 62075715-28f8-4e64-aef4-2f0b7cce8fdc {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:02 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3793bb24-16ea-41e8-8dc5-1505e27b4a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779b5a56-bb07-4698-970b-0b8ab0895a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37bd856793f44f3caea05fe3bd48cdab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:02Z,use_quota=True,user_id='906463bc37464e8d97e491c9155c35fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27061f87-0736-48d1-a96e-bc095f0803a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27061f87-0736-48d1-a96e-bc095f0803a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack sudo[105227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc 1073741824
Jul 14 18:09:02 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c215e5-0181-4169-8556-276e1f371f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965efef5-9627-4ec7-b4b7-22f080ad257a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a11cba-debf-4e1e-ba9b-1d1060d38a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Volume volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831 (6824c03a-919a-423f-8ca0-dc5d9bf5a831): created successfully
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a11cba-debf-4e1e-ba9b-1d1060d38a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Flow 'volume_create_manager' (f9da6b96-3016-46d0-93ac-71e2813547b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Flow 'volume_create_manager' (5a3e2d71-9514-4679-a5ee-c2d775fb8ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305152a6-079e-42fb-9829-f0d4ee61926f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-19b46193-cd4e-41aa-a6e2-dc22dd64bea0 tempest-CreateVolumesFromImageTest-2038004719 None] Created volume successfully.
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305152a6-079e-42fb-9829-f0d4ee61926f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2079262669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129970e5-7378-45a4-9799-06d2de345490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d64385258d49b8908f2e2548a9d30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:02Z,use_quota=True,user_id='de52f9dff5374c9582addf42c1a78f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6c0348-8977-4376-9506-2c2be354f84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6c0348-8977-4376-9506-2c2be354f84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eb9e20-3572-47cd-8e34-3f41cd175192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eb9e20-3572-47cd-8e34-3f41cd175192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '129970e5-7378-45a4-9799-06d2de345490', 'volume_name': 'volume-129970e5-7378-45a4-9799-06d2de345490', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcbf4e1-76b6-4d82-a0fc-2c3429737234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcbf4e1-76b6-4d82-a0fc-2c3429737234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e193bb3-1d35-44e1-a4c0-2f20a54b747e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume 129970e5-7378-45a4-9799-06d2de345490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-129970e5-7378-45a4-9799-06d2de345490', 'volume_size': 1}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Flow 'volume_create_manager' (2e9d7c2e-3386-466f-979b-e801b24b0bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc214c1a-70b7-419b-b631-5bcb8dc61a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc214c1a-70b7-419b-b631-5bcb8dc61a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62916507-3196-46a6-9ca6-54b027fdbd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c5f8c35b234f1b81e029cc1218ac60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:02Z,use_quota=True,user_id='1910190f4c4c499eaa650adb2a312d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8afc4d5-2b63-4107-b41f-fbaa40d07771),volume_type_id=e8afc4d5-2b63-4107-b41f-fbaa40d07771)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4993e6fd-3155-4118-9d9b-54b5cdabf650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4993e6fd-3155-4118-9d9b-54b5cdabf650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a702f6b9-0142-48f0-9b5c-eb9755667d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.image.glance [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Creating Keystone auth plugin from conf {{(pid=87401) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c215e5-0181-4169-8556-276e1f371f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '779b5a56-bb07-4698-970b-0b8ab0895a4e', 'volume_name': 'volume-779b5a56-bb07-4698-970b-0b8ab0895a4e', 'volume_size': 1, 'image_id': 'ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63f4817a82125e32542c50b75ebd1263', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37bd856793f44f3caea05fe3bd48cdab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e483e826b75a79ecc87a1209b5d77ba6ad63479ca9984a619cc86b7173f80590619a03c18a0a7b55faf42d76be86b9c4390666c206c05a7384cf20a3094f346c', 'id': 'ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'created_at': datetime.datetime(2026, 7, 14, 16, 8, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 16, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddb1d94d-4997-4a50-bc9f-0b27e31c0086/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca44dd00>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55660841-eecc-4010-8a2d-813372166cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55660841-eecc-4010-8a2d-813372166cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3d88c0-5bab-48bb-afd9-c8dca2ab1265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Volume 779b5a56-bb07-4698-970b-0b8ab0895a4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-779b5a56-bb07-4698-970b-0b8ab0895a4e', 'volume_size': 1, 'image_id': 'ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63f4817a82125e32542c50b75ebd1263', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37bd856793f44f3caea05fe3bd48cdab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e483e826b75a79ecc87a1209b5d77ba6ad63479ca9984a619cc86b7173f80590619a03c18a0a7b55faf42d76be86b9c4390666c206c05a7384cf20a3094f346c', 'id': 'ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'created_at': datetime.datetime(2026, 7, 14, 16, 8, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 16, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddb1d94d-4997-4a50-bc9f-0b27e31c0086/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca44dd00>}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Trying to clone 779b5a56-bb07-4698-970b-0b8ab0895a4e from image ddb1d94d-4997-4a50-bc9f-0b27e31c0086 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 18:09:02 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc 1073741824" returned: 0 in 0.612s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:02 devstack sudo[105233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc
Jul 14 18:09:02 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 18:09:02 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Image download 0.00 MB at 0.00 MB/s
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b58724-fb67-4f15-959e-302cfbc9de49]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a702f6b9-0142-48f0-9b5c-eb9755667d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '62916507-3196-46a6-9ca6-54b027fdbd43', 'volume_name': 'volume-62916507-3196-46a6-9ca6-54b027fdbd43', 'volume_size': 1, 'image_id': '2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f72a4673550d707fdf2ddcb73a3a32c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '96c5f8c35b234f1b81e029cc1218ac60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df45294426f238ea0136cceff3957c0865db48a26e0d3ba566a692e69eee0d05746c847e34b0ed22834f84007c5df90421ccd750707d18b14b53c55be5113508', 'id': '2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'created_at': datetime.datetime(2026, 7, 14, 16, 8, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 16, 9, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2bff4f350>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd908c8-3df9-482b-ba57-4b237ab67616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd908c8-3df9-482b-ba57-4b237ab67616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ea7055-1adc-4b38-8d8f-48468dac2ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:02 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Volume 62916507-3196-46a6-9ca6-54b027fdbd43: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-62916507-3196-46a6-9ca6-54b027fdbd43', 'volume_size': 1, 'image_id': '2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f72a4673550d707fdf2ddcb73a3a32c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '96c5f8c35b234f1b81e029cc1218ac60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df45294426f238ea0136cceff3957c0865db48a26e0d3ba566a692e69eee0d05746c847e34b0ed22834f84007c5df90421ccd750707d18b14b53c55be5113508', 'id': '2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'created_at': datetime.datetime(2026, 7, 14, 16, 8, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 16, 9, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2bff4f350>}
Jul 14 18:09:02 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Trying to clone 62916507-3196-46a6-9ca6-54b027fdbd43 from image 2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e at location (None, [{'url': 'file:///opt/stack/data/glance/images/2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'metadata': {}}]). {{(pid=87401) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 18:09:02 devstack sudo[105235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD
Jul 14 18:09:02 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 18:09:03 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Image download 0.00 MB at 0.00 MB/s
Jul 14 18:09:03 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc" returned: 0 in 0.306s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.801s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1719050650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9247c4b-a22e-4d2e-af8e-2e62a281f8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a1c6506e7c499ebe538ce0283cc86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:08:59Z,use_quota=True,user_id='afe637a33f2b4010812b8940e4c72add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Creating volume a9247c4b-a22e-4d2e-af8e-2e62a281f8e2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:03 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:03 devstack sudo[105238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2 1073741824
Jul 14 18:09:03 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3563ab7-dece-4f6b-9415-77a2ce4560db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee11dab-c006-4878-8ef7-b7b1a09fbc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1688f7e-e5d9-468f-b453-21215808a88d]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:03 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Volume volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc (62075715-28f8-4e64-aef4-2f0b7cce8fdc): created successfully
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee11dab-c006-4878-8ef7-b7b1a09fbc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Flow 'volume_create_manager' (dac435d2-1c42-4f15-ba17-750f38759f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bf185323-d80d-42d2-9cd6-fa73f83e8b11 tempest-CreateVolumesFromImageTest-2038004719 None] Created volume successfully.
Jul 14 18:09:03 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:03 devstack sudo[105240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD
Jul 14 18:09:03 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:03 devstack sudo[105243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD
Jul 14 18:09:03 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:03 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:03 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2 1073741824" returned: 0 in 0.551s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:03 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Temporary image ddb1d94d-4997-4a50-bc9f-0b27e31c0086 is fetched for user 906463bc37464e8d97e491c9155c35fc. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 18:09:03 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:03 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:03 devstack sudo[105257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2
Jul 14 18:09:03 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5baf03c-ae83-4041-85d8-8d97b23dd4d2]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:03 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Temporary image 2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e is fetched for user 1910190f4c4c499eaa650adb2a312d8f. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 18:09:03 devstack sudo[105259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD
Jul 14 18:09:03 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3341ce60-f8b9-492d-80d2-4d4b508acbe4]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:04 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2" returned: 0 in 0.354s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.147s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2101703306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e307cf-d671-4650-b3a4-0930e01d7600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d64385258d49b8908f2e2548a9d30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:00Z,use_quota=True,user_id='de52f9dff5374c9582addf42c1a78f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Creating volume 54e307cf-d671-4650-b3a4-0930e01d7600 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-54e307cf-d671-4650-b3a4-0930e01d7600 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c4ca19-6d44-487f-ab21-083fe885c559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218deb6b-e058-4aff-ba7d-ab1193ee187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:04 devstack sudo[105266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-54e307cf-d671-4650-b3a4-0930e01d7600 1073741824
Jul 14 18:09:04 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Volume volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2 (a9247c4b-a22e-4d2e-af8e-2e62a281f8e2): created successfully
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218deb6b-e058-4aff-ba7d-ab1193ee187a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Flow 'volume_create_manager' (bb020964-8dc9-495b-8b8d-5331eb848ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-41e6ccde-49d0-48a1-b4fd-2dbf9e88dd1b tempest-CreateVolumesFromImageTest-2038004719 None] Created volume successfully.
Jul 14 18:09:04 devstack sudo[105265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD
Jul 14 18:09:04 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:04 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:04 devstack sudo[105271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD
Jul 14 18:09:04 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:04 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:04 devstack sudo[105278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD
Jul 14 18:09:04 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:04 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-54e307cf-d671-4650-b3a4-0930e01d7600 1073741824" returned: 0 in 0.481s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-54e307cf-d671-4650-b3a4-0930e01d7600 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:04 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:04 devstack sudo[105284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-54e307cf-d671-4650-b3a4-0930e01d7600
Jul 14 18:09:04 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:04 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:04 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-54e307cf-d671-4650-b3a4-0930e01d7600" returned: 0 in 0.268s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.322s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1542412384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00ec01b-50a0-440d-94ff-126d70e6b632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d64385258d49b8908f2e2548a9d30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:00Z,use_quota=True,user_id='de52f9dff5374c9582addf42c1a78f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Creating volume a00ec01b-50a0-440d-94ff-126d70e6b632 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a00ec01b-50a0-440d-94ff-126d70e6b632 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff04a115-2eaa-4727-9ba3-00e7ccd843f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e307cf-d671-4650-b3a4-0930e01d7600', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7865a9a3-9be0-46a7-b60f-d8f2d1e99707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:04 devstack sudo[105290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a00ec01b-50a0-440d-94ff-126d70e6b632 1073741824
Jul 14 18:09:04 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume volume-54e307cf-d671-4650-b3a4-0930e01d7600 (54e307cf-d671-4650-b3a4-0930e01d7600): created successfully
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7865a9a3-9be0-46a7-b60f-d8f2d1e99707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Flow 'volume_create_manager' (89faab41-8034-4ef0-8dbd-ad6124da20a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:04 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b5ae760e-dcf3-4489-8f43-19cad01a0359 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Created volume successfully.
Jul 14 18:09:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "cinder-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "cinder-quobyte-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-quobyte-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8996dc0c-badd-447a-bd94-09265fd9e8be]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:05 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2
Jul 14 18:09:05 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:05 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a00ec01b-50a0-440d-94ff-126d70e6b632 1073741824" returned: 0 in 0.474s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a00ec01b-50a0-440d-94ff-126d70e6b632 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:05 devstack sudo[105299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a00ec01b-50a0-440d-94ff-126d70e6b632
Jul 14 18:09:05 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:05 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2" returned: 0 in 0.408s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:05 devstack sudo[105304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2
Jul 14 18:09:05 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:05 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a00ec01b-50a0-440d-94ff-126d70e6b632" returned: 0 in 0.277s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.389s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1549804835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd45a8c-3524-426d-b0d4-10ee9783a82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d64385258d49b8908f2e2548a9d30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:01Z,use_quota=True,user_id='de52f9dff5374c9582addf42c1a78f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Creating volume afd45a8c-3524-426d-b0d4-10ee9783a82c {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:05 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afd45a8c-3524-426d-b0d4-10ee9783a82c 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a12cbc2-bd60-42da-99d4-fd7b92c2aea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a00ec01b-50a0-440d-94ff-126d70e6b632', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947e4202-6997-47c4-acd7-e67072072092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:05 devstack sudo[105307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afd45a8c-3524-426d-b0d4-10ee9783a82c 1073741824
Jul 14 18:09:05 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume volume-a00ec01b-50a0-440d-94ff-126d70e6b632 (a00ec01b-50a0-440d-94ff-126d70e6b632): created successfully
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947e4202-6997-47c4-acd7-e67072072092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Flow 'volume_create_manager' (766ea92c-0e51-4d25-84f6-6c5523494ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d58aa699-7974-4ecd-91e5-58410a7c0455 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Created volume successfully.
Jul 14 18:09:05 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2" returned: 0 in 0.272s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-quobyte-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2" released by "delete_volume" :: held 0.732s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Created reservations ['0ac3a7cc-f4b7-4542-b99f-da7bc92509d7', 'bb17c79c-3fba-46bd-838f-9e1d359c886f', 'daf0dba3-71b9-4fce-981a-b58b3c9281a1', 'f749552b-beeb-4b7b-a902-e3390bff8196'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:05 devstack sudo[105313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:05 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:06 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afd45a8c-3524-426d-b0d4-10ee9783a82c 1073741824" returned: 0 in 0.483s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afd45a8c-3524-426d-b0d4-10ee9783a82c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:06 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "cinder-62075715-28f8-4e64-aef4-2f0b7cce8fdc-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:06 devstack sudo[105316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afd45a8c-3524-426d-b0d4-10ee9783a82c
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:06 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-62075715-28f8-4e64-aef4-2f0b7cce8fdc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Deleted volume successfully.
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-14d703bb-aeb0-4583-96c4-e3884dd55b77 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-a9247c4b-a22e-4d2e-af8e-2e62a281f8e2-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "cinder-quobyte-62075715-28f8-4e64-aef4-2f0b7cce8fdc" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-quobyte-62075715-28f8-4e64-aef4-2f0b7cce8fdc" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e40eb4c-c5e7-4cf8-bf87-bc76e9372901]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:06 devstack sudo[105318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc
Jul 14 18:09:06 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:06 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afd45a8c-3524-426d-b0d4-10ee9783a82c" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.507s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1798170742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fbee33-3874-4a45-892d-57fc6d23d748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d64385258d49b8908f2e2548a9d30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:02Z,use_quota=True,user_id='de52f9dff5374c9582addf42c1a78f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Creating volume 27fbee33-3874-4a45-892d-57fc6d23d748 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:06 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-27fbee33-3874-4a45-892d-57fc6d23d748 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06464841-c0c0-4ea8-806a-e85636d32c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd45a8c-3524-426d-b0d4-10ee9783a82c', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d26035-59eb-46c2-b500-13b6289c13c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:06 devstack sudo[105321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-27fbee33-3874-4a45-892d-57fc6d23d748 1073741824
Jul 14 18:09:06 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:06 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume volume-afd45a8c-3524-426d-b0d4-10ee9783a82c (afd45a8c-3524-426d-b0d4-10ee9783a82c): created successfully
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d26035-59eb-46c2-b500-13b6289c13c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Flow 'volume_create_manager' (3853171a-2cc3-4ab2-93dd-de5d715667ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:06 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f5abf9a6-9cab-4b57-bccb-17cd6d2e5fea tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Created volume successfully.
Jul 14 18:09:06 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc" returned: 0 in 0.379s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:06 devstack sudo[105328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc
Jul 14 18:09:06 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:06 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-27fbee33-3874-4a45-892d-57fc6d23d748 1073741824" returned: 0 in 0.488s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:07 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62075715-28f8-4e64-aef4-2f0b7cce8fdc" returned: 0 in 0.266s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-quobyte-62075715-28f8-4e64-aef4-2f0b7cce8fdc" released by "delete_volume" :: held 0.699s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-27fbee33-3874-4a45-892d-57fc6d23d748 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:07 devstack sudo[105332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-27fbee33-3874-4a45-892d-57fc6d23d748
Jul 14 18:09:07 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Created reservations ['656e1f89-aa4b-4485-9018-69c8a7bd5b93', '60365973-ed72-424f-ad57-a777a714d0c7', '2f360eec-5dfd-4612-a509-043db50196b2', '1e1d23e9-c02a-4220-a9d2-696d20665f9a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:07 devstack sudo[105334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:07 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:07 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-27fbee33-3874-4a45-892d-57fc6d23d748" returned: 0 in 0.275s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.952s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2079262669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129970e5-7378-45a4-9799-06d2de345490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d64385258d49b8908f2e2548a9d30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:02Z,use_quota=True,user_id='de52f9dff5374c9582addf42c1a78f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Creating volume 129970e5-7378-45a4-9799-06d2de345490 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:07 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-129970e5-7378-45a4-9799-06d2de345490 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0059185a-838d-41bf-9918-181b25844813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27fbee33-3874-4a45-892d-57fc6d23d748', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:07 devstack sudo[105337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-129970e5-7378-45a4-9799-06d2de345490 1073741824
Jul 14 18:09:07 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656dbffe-a9e8-4d7a-82b7-6736bf0a2364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:07 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume volume-27fbee33-3874-4a45-892d-57fc6d23d748 (27fbee33-3874-4a45-892d-57fc6d23d748): created successfully
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656dbffe-a9e8-4d7a-82b7-6736bf0a2364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Flow 'volume_create_manager' (6720d9d5-fada-47b4-8367-d3d418a263ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "cinder-6824c03a-919a-423f-8ca0-dc5d9bf5a831-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-37bff262-0a69-49a6-b355-8e0ff6141322 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Created volume successfully.
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-6824c03a-919a-423f-8ca0-dc5d9bf5a831-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:07 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.350s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Deleted volume successfully.
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "cinder-quobyte-6824c03a-919a-423f-8ca0-dc5d9bf5a831" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-quobyte-6824c03a-919a-423f-8ca0-dc5d9bf5a831" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-10fe5ce2-373e-4536-903d-57c6f16a68b0 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-62075715-28f8-4e64-aef4-2f0b7cce8fdc-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ecd701-f4f8-4a4f-993c-6bc1a9df6f8c]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:07 devstack sudo[105340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831
Jul 14 18:09:07 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:07 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-129970e5-7378-45a4-9799-06d2de345490 1073741824" returned: 0 in 0.515s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-129970e5-7378-45a4-9799-06d2de345490 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:07 devstack sudo[105346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-129970e5-7378-45a4-9799-06d2de345490
Jul 14 18:09:07 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:07 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831" returned: 0 in 0.394s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:08 devstack sudo[105351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831
Jul 14 18:09:08 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:08 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-129970e5-7378-45a4-9799-06d2de345490" returned: 0 in 0.249s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.570s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779b5a56-bb07-4698-970b-0b8ab0895a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37bd856793f44f3caea05fe3bd48cdab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:02Z,use_quota=True,user_id='906463bc37464e8d97e491c9155c35fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Creating volume 779b5a56-bb07-4698-970b-0b8ab0895a4e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:08 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e193bb3-1d35-44e1-a4c0-2f20a54b747e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-129970e5-7378-45a4-9799-06d2de345490', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:08 devstack sudo[105354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e 1073741824
Jul 14 18:09:08 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff62644-73b4-41f1-ada1-f871baf34ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:08 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Volume volume-129970e5-7378-45a4-9799-06d2de345490 (129970e5-7378-45a4-9799-06d2de345490): created successfully
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff62644-73b4-41f1-ada1-f871baf34ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Flow 'volume_create_manager' (5a3e2d71-9514-4679-a5ee-c2d775fb8ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3df3c4a8-d484-40bf-a385-4541063b83c6 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Created volume successfully.
Jul 14 18:09:08 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6824c03a-919a-423f-8ca0-dc5d9bf5a831" returned: 0 in 0.267s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-quobyte-6824c03a-919a-423f-8ca0-dc5d9bf5a831" released by "delete_volume" :: held 0.718s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Created reservations ['8a5f9636-9b7d-410c-9e5d-f68082fb5626', '34da3bc0-bcad-47f2-bd3d-54374a316994', '759e2d8e-cb96-448c-b2f4-643442092c3d', 'b3bb2386-0086-4540-8e5b-a6ec58c5cb48'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:08 devstack sudo[105360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:08 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:08 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e 1073741824" returned: 0 in 0.420s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:08 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e
Jul 14 18:09:08 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "cinder-ff9caad8-0bc9-4312-86f8-7632f831439e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-ff9caad8-0bc9-4312-86f8-7632f831439e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:08 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.313s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Deleted volume successfully.
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17acc465-dc10-4150-97a6-c002a811f080 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-6824c03a-919a-423f-8ca0-dc5d9bf5a831-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "cinder-quobyte-ff9caad8-0bc9-4312-86f8-7632f831439e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-quobyte-ff9caad8-0bc9-4312-86f8-7632f831439e" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[198a4ff4-e933-4208-b34e-9e562eed14da]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ff9caad8-0bc9-4312-86f8-7632f831439e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "cinder-129970e5-7378-45a4-9799-06d2de345490-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-129970e5-7378-45a4-9799-06d2de345490-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "cinder-quobyte-129970e5-7378-45a4-9799-06d2de345490" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-quobyte-129970e5-7378-45a4-9799-06d2de345490" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39716d4-3e69-412d-a2ca-e31f3bdd0969]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-129970e5-7378-45a4-9799-06d2de345490 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:08 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ff9caad8-0bc9-4312-86f8-7632f831439e
Jul 14 18:09:08 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:08 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e" returned: 0 in 0.374s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.250s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62916507-3196-46a6-9ca6-54b027fdbd43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c5f8c35b234f1b81e029cc1218ac60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:02Z,use_quota=True,user_id='1910190f4c4c499eaa650adb2a312d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8afc4d5-2b63-4107-b41f-fbaa40d07771),volume_type_id=e8afc4d5-2b63-4107-b41f-fbaa40d07771)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Creating volume 62916507-3196-46a6-9ca6-54b027fdbd43 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:09 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:09 devstack sudo[105369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 1073741824
Jul 14 18:09:09 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Attempting download of ddb1d94d-4997-4a50-bc9f-0b27e31c0086 ((None, [{'url': 'file:///opt/stack/data/glance/images/ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'metadata': {}}])) to volume 779b5a56-bb07-4698-970b-0b8ab0895a4e. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 18:09:09 devstack sudo[105367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-129970e5-7378-45a4-9799-06d2de345490
Jul 14 18:09:09 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd0ab18-54ed-4217-8058-7a9b855f8802]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_bt216d_x {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:09 devstack sudo[105372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_bt216d_x
Jul 14 18:09:09 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:09 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ff9caad8-0bc9-4312-86f8-7632f831439e" returned: 0 in 0.469s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ff9caad8-0bc9-4312-86f8-7632f831439e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:09 devstack sudo[105381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ff9caad8-0bc9-4312-86f8-7632f831439e
Jul 14 18:09:09 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:09 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-129970e5-7378-45a4-9799-06d2de345490" returned: 0 in 0.430s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-129970e5-7378-45a4-9799-06d2de345490 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:09 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-129970e5-7378-45a4-9799-06d2de345490
Jul 14 18:09:09 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:09 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_bt216d_x" returned: 0 in 0.387s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_bt216d_x {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:09 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 1073741824" returned: 0 in 0.558s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:09 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ff9caad8-0bc9-4312-86f8-7632f831439e" returned: 0 in 0.315s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-quobyte-ff9caad8-0bc9-4312-86f8-7632f831439e" released by "delete_volume" :: held 0.844s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:09 devstack sudo[105394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43
Jul 14 18:09:09 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:09 devstack sudo[105392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_bt216d_x
Jul 14 18:09:09 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Created reservations ['fea33cc2-4e88-4da4-a0a5-5c565ce8bb66', '3d040c9a-01a2-4b9e-b913-e1ceca45b04e', '6ec44f82-aa8f-49a8-87ba-c868e64203ea', '4467d9a4-c088-4d61-93ae-1b69c8338639'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:09 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-129970e5-7378-45a4-9799-06d2de345490" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-quobyte-129970e5-7378-45a4-9799-06d2de345490" released by "delete_volume" :: held 0.794s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Created reservations ['6436d0d3-5313-46a7-9bf6-040379ac2b0a', '98212f19-0afa-4a08-b7ef-6b9ed419b511', 'a08e8b51-02f9-4900-b6a8-0c2d675f65de', '0b482ee3-65bd-461e-9797-016e1ed98d06'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:09 devstack sudo[105399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:09 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:09 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_bt216d_x" returned: 1 in 0.415s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_bt216d_x' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8312f57b-f8b7-4c74-8478-03cf7568e3e5]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "cinder-ad979f4c-b076-4526-9445-988efbdbbceb-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-ad979f4c-b076-4526-9445-988efbdbbceb-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:10 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "cinder-27fbee33-3874-4a45-892d-57fc6d23d748-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43" returned: 0 in 0.492s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:10 devstack sudo[105404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD
Jul 14 18:09:10 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-27fbee33-3874-4a45-892d-57fc6d23d748-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:10 devstack sudo[105406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:10 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "cinder-quobyte-ad979f4c-b076-4526-9445-988efbdbbceb" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Attempting download of 2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e ((None, [{'url': 'file:///opt/stack/data/glance/images/2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'metadata': {}}])) to volume 62916507-3196-46a6-9ca6-54b027fdbd43. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-quobyte-ad979f4c-b076-4526-9445-988efbdbbceb" acquired by "delete_volume" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "cinder-quobyte-27fbee33-3874-4a45-892d-57fc6d23d748" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d462b564-9b82-4e79-81ce-70e3a7cb2b16]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ad979f4c-b076-4526-9445-988efbdbbceb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:10 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:10 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-quobyte-27fbee33-3874-4a45-892d-57fc6d23d748" acquired by "delete_volume" :: waited 0.104s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.658s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[250138ba-6199-49ff-b764-059679956e2d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[78699651-5197-4dc1-8a07-d0574a59dcce]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-27fbee33-3874-4a45-892d-57fc6d23d748 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:10 devstack sudo[105411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ad979f4c-b076-4526-9445-988efbdbbceb
Jul 14 18:09:10 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_j8728f8i {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Deleted volume successfully.
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bb95c2dc-67d0-4fbb-a12b-52c2b764ddbb tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-ff9caad8-0bc9-4312-86f8-7632f831439e-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:10 devstack sudo[105412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD
Jul 14 18:09:10 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:10 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:10 devstack sudo[105415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_j8728f8i
Jul 14 18:09:10 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.516s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:10 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Deleted volume successfully.
Jul 14 18:09:10 devstack sudo[105413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-27fbee33-3874-4a45-892d-57fc6d23d748
Jul 14 18:09:10 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-17b3c6dd-53d0-496d-b227-a2b748ecea01 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-129970e5-7378-45a4-9799-06d2de345490-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:10 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ad979f4c-b076-4526-9445-988efbdbbceb" returned: 0 in 0.477s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ad979f4c-b076-4526-9445-988efbdbbceb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:10 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ad979f4c-b076-4526-9445-988efbdbbceb
Jul 14 18:09:10 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:10 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_j8728f8i" returned: 0 in 0.379s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_j8728f8i {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:10 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD" returned: 1 in 0.498s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] ddb1d94d-4997-4a50-bc9f-0b27e31c0086 was raw, converting to raw {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 18:09:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:10 devstack sudo[105434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e
Jul 14 18:09:10 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:11 devstack sudo[105431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_j8728f8i
Jul 14 18:09:11 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:11 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-27fbee33-3874-4a45-892d-57fc6d23d748" returned: 0 in 0.577s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-27fbee33-3874-4a45-892d-57fc6d23d748 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:11 devstack sudo[105438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-27fbee33-3874-4a45-892d-57fc6d23d748
Jul 14 18:09:11 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:11 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ad979f4c-b076-4526-9445-988efbdbbceb" returned: 0 in 0.381s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-quobyte-ad979f4c-b076-4526-9445-988efbdbbceb" released by "delete_volume" :: held 0.982s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Created reservations ['93283512-c29f-4187-8445-40fadab67f9f', '3d974dce-445d-44a7-97d8-862971958871', '28b5bed6-d597-4661-898d-27143b4f100b', '0966721f-c8cc-4892-8b4c-a95fd05fc337'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:11 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_j8728f8i" returned: 1 in 0.435s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_j8728f8i' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6967e54-5b82-4a91-aaab-5dfa6b7e8404]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:11 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-27fbee33-3874-4a45-892d-57fc6d23d748" returned: 0 in 0.295s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-quobyte-27fbee33-3874-4a45-892d-57fc6d23d748" released by "delete_volume" :: held 0.944s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:11 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e" returned: 0 in 0.479s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ddb1d94d-4997-4a50-bc9f-0b27e31c0086_ks4cn7ucdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:09:11 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Converted 0.00 MB image at 0.00 MB/s
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:11 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e 1G
Jul 14 18:09:11 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:11 devstack sudo[105448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD
Jul 14 18:09:11 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:11 devstack sudo[105452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:11 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Created reservations ['ed622913-5098-48ab-be39-25b9fa473339', '159a570b-6702-4bd6-ab4b-dd26312e5922', '60337e64-5278-488c-8e8b-ff9236d6cf6f', 'b82ac8ec-14b3-4179-a6ff-8e780d4055ba'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:11 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:11 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:11 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:11 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e 1G" returned: 0 in 0.466s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:11 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.415s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Deleted volume successfully.
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-92c568bd-38fe-49fc-a43c-23703cedb969 tempest-CreateVolumesFromImageTest-2038004719 None] Lock "cinder-ad979f4c-b076-4526-9445-988efbdbbceb-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef0af5f-d593-49c7-81fa-fd918d00a9f8]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:11 devstack sudo[105461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD
Jul 14 18:09:11 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:12 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.335s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Deleted volume successfully.
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0f3b3d7-61c7-4929-8348-107b3f12afdc tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-27fbee33-3874-4a45-892d-57fc6d23d748-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:12 devstack sudo[105465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e
Jul 14 18:09:12 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:12 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD" returned: 1 in 0.507s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] 2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e was raw, converting to raw {{(pid=87401) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:12 devstack sudo[105472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43
Jul 14 18:09:12 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:12 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "cinder-afd45a8c-3524-426d-b0d4-10ee9783a82c-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e" returned: 0 in 0.491s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-afd45a8c-3524-426d-b0d4-10ee9783a82c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "cinder-quobyte-afd45a8c-3524-426d-b0d4-10ee9783a82c" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-quobyte-afd45a8c-3524-426d-b0d4-10ee9783a82c" acquired by "delete_volume" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:12 devstack sudo[105474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e
Jul 14 18:09:12 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4abaee-e6f0-4b49-8906-b4e9afed369f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afd45a8c-3524-426d-b0d4-10ee9783a82c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:12 devstack sudo[105477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afd45a8c-3524-426d-b0d4-10ee9783a82c
Jul 14 18:09:12 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:12 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43" returned: 0 in 0.506s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e_bbfb1x3jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:09:12 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Converted 0.00 MB image at 0.00 MB/s
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:12 devstack sudo[105483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 1G
Jul 14 18:09:12 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:12 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e" returned: 1 in 0.463s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Downloaded image ddb1d94d-4997-4a50-bc9f-0b27e31c0086 ((None, [{'url': 'file:///opt/stack/data/glance/images/ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'metadata': {}}])) to volume 779b5a56-bb07-4698-970b-0b8ab0895a4e successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Temporary image ddb1d94d-4997-4a50-bc9f-0b27e31c0086 for user 906463bc37464e8d97e491c9155c35fc is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Marking volume 779b5a56-bb07-4698-970b-0b8ab0895a4e as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Copying metadata from image ddb1d94d-4997-4a50-bc9f-0b27e31c0086 to 779b5a56-bb07-4698-970b-0b8ab0895a4e. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 18:09:12 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Creating volume glance metadata for volume 779b5a56-bb07-4698-970b-0b8ab0895a4e backed by image ddb1d94d-4997-4a50-bc9f-0b27e31c0086 with: {'image_id': 'ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '63f4817a82125e32542c50b75ebd1263', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3d88c0-5bab-48bb-afd9-c8dca2ab1265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779b5a56-bb07-4698-970b-0b8ab0895a4e', 'volume_size': 1, 'image_id': 'ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63f4817a82125e32542c50b75ebd1263', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37bd856793f44f3caea05fe3bd48cdab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e483e826b75a79ecc87a1209b5d77ba6ad63479ca9984a619cc86b7173f80590619a03c18a0a7b55faf42d76be86b9c4390666c206c05a7384cf20a3094f346c', 'id': 'ddb1d94d-4997-4a50-bc9f-0b27e31c0086', 'created_at': datetime.datetime(2026, 7, 14, 16, 8, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 16, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddb1d94d-4997-4a50-bc9f-0b27e31c0086/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2ca44dd00>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed0c20e-9e0f-4a31-88a5-d7a9db824814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:13 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Volume volume-779b5a56-bb07-4698-970b-0b8ab0895a4e (779b5a56-bb07-4698-970b-0b8ab0895a4e): created successfully
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed0c20e-9e0f-4a31-88a5-d7a9db824814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Flow 'volume_create_manager' (c60af0f8-e7f6-4a2b-9447-abfbc5c9be03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b03c0bbc-b57a-49fd-97ec-ace8f213aacc tempest-VolumeImageDependencyTests-1006672786 None] Created volume successfully.
Jul 14 18:09:13 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afd45a8c-3524-426d-b0d4-10ee9783a82c" returned: 0 in 0.531s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afd45a8c-3524-426d-b0d4-10ee9783a82c {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:13 devstack sudo[105492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afd45a8c-3524-426d-b0d4-10ee9783a82c
Jul 14 18:09:13 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:13 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 1G" returned: 0 in 0.377s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ea3a0d-2c4e-430c-a01d-c341942f5c9a]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:13 devstack sudo[105494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43
Jul 14 18:09:13 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:13 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-afd45a8c-3524-426d-b0d4-10ee9783a82c" returned: 0 in 0.257s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-quobyte-afd45a8c-3524-426d-b0d4-10ee9783a82c" released by "delete_volume" :: held 0.844s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Created reservations ['e40e53c0-b799-4a1d-a77a-b4dcd0872920', 'f036b35e-9eb1-4887-a562-c96009ebfe1b', '99332872-3d66-40d5-8916-93ff08ff86de', '96e94c7e-f210-419b-9ed0-b1b97d833415'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Acquiring lock "cinder-779b5a56-bb07-4698-970b-0b8ab0895a4e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:13 devstack sudo[105498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:13 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Lock "cinder-779b5a56-bb07-4698-970b-0b8ab0895a4e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Acquiring lock "cinder-quobyte-779b5a56-bb07-4698-970b-0b8ab0895a4e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "cinder-a00ec01b-50a0-440d-94ff-126d70e6b632-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Lock "cinder-quobyte-779b5a56-bb07-4698-970b-0b8ab0895a4e" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:13 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-a00ec01b-50a0-440d-94ff-126d70e6b632-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43" returned: 0 in 0.542s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d173731-75bd-4e65-a3e0-52adda9b634e]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "cinder-quobyte-a00ec01b-50a0-440d-94ff-126d70e6b632" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-quobyte-a00ec01b-50a0-440d-94ff-126d70e6b632" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[db724e40-7e72-4661-aa6c-731834ad4fed]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a00ec01b-50a0-440d-94ff-126d70e6b632 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:13 devstack sudo[105502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e
Jul 14 18:09:13 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:13 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:14 devstack sudo[105501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43
Jul 14 18:09:14 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Deleted volume successfully.
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-534f9453-4cba-4f71-8bb9-33d12c596fd7 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-afd45a8c-3524-426d-b0d4-10ee9783a82c-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:14 devstack sudo[105503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a00ec01b-50a0-440d-94ff-126d70e6b632
Jul 14 18:09:14 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:14 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e" returned: 0 in 0.452s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:14 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43" returned: 1 in 0.535s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Downloaded image 2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e ((None, [{'url': 'file:///opt/stack/data/glance/images/2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'metadata': {}}])) to volume 62916507-3196-46a6-9ca6-54b027fdbd43 successfully. {{(pid=87401) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Temporary image 2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e for user 1910190f4c4c499eaa650adb2a312d8f is deleted. {{(pid=87401) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.volume.volume_utils [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Marking volume 62916507-3196-46a6-9ca6-54b027fdbd43 as bootable. {{(pid=87401) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Copying metadata from image 2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e to 62916507-3196-46a6-9ca6-54b027fdbd43. {{(pid=87401) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Creating volume glance metadata for volume 62916507-3196-46a6-9ca6-54b027fdbd43 backed by image 2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f72a4673550d707fdf2ddcb73a3a32c3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87401) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ea7055-1adc-4b38-8d8f-48468dac2ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62916507-3196-46a6-9ca6-54b027fdbd43', 'volume_size': 1, 'image_id': '2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f72a4673550d707fdf2ddcb73a3a32c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '96c5f8c35b234f1b81e029cc1218ac60', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df45294426f238ea0136cceff3957c0865db48a26e0d3ba566a692e69eee0d05746c847e34b0ed22834f84007c5df90421ccd750707d18b14b53c55be5113508', 'id': '2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e', 'created_at': datetime.datetime(2026, 7, 14, 16, 8, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 16, 9, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a0129f4-6db0-4cbc-8c0b-67ac1dd8ea2e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70a2bff4f350>}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15087244-59a5-418d-a861-8826ffc4ea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:14 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a00ec01b-50a0-440d-94ff-126d70e6b632" returned: 0 in 0.529s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a00ec01b-50a0-440d-94ff-126d70e6b632 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:14 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e
Jul 14 18:09:14 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:14 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Volume volume-62916507-3196-46a6-9ca6-54b027fdbd43 (62916507-3196-46a6-9ca6-54b027fdbd43): created successfully
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15087244-59a5-418d-a861-8826ffc4ea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:14 devstack sudo[105519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a00ec01b-50a0-440d-94ff-126d70e6b632
Jul 14 18:09:14 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Flow 'volume_create_manager' (2e9d7c2e-3386-466f-979b-e801b24b0bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5f14b4de-900b-4fc4-bffa-5fdbab0b0eb7 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Created volume successfully.
Jul 14 18:09:14 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e" returned: 1 in 0.428s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:14 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e
Jul 14 18:09:14 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:14 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a00ec01b-50a0-440d-94ff-126d70e6b632" returned: 0 in 0.308s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-quobyte-a00ec01b-50a0-440d-94ff-126d70e6b632" released by "delete_volume" :: held 0.907s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Created reservations ['d3882e91-8d97-4e10-9abb-228859ba37dd', '478e14e6-dd20-46e3-af29-2aa1e48afbba', '21d63554-d3d2-4133-8e69-1a00aae4baf2', 'fb24785f-32bf-4b7b-ab62-bcc26940295b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:14 devstack sudo[105528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:14 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:15 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-779b5a56-bb07-4698-970b-0b8ab0895a4e" returned: 0 in 0.309s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Lock "cinder-quobyte-779b5a56-bb07-4698-970b-0b8ab0895a4e" released by "delete_volume" :: held 1.303s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Created reservations ['dfa2907b-c050-4f2e-bd23-278db1354f91', 'ce9cbd92-6e27-4a8a-895d-58755c7191be', '4668cfb4-e0b4-4e1c-8a26-ee40000afb31', 'a279f646-012b-423c-8006-09a4077e0a4e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:15 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:15 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Deleted volume successfully.
Jul 14 18:09:15 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d74344aa-cfbf-4018-8de4-1e4c52dec1aa tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-a00ec01b-50a0-440d-94ff-126d70e6b632-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Acquiring lock "cinder-62916507-3196-46a6-9ca6-54b027fdbd43-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:15 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.290s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Lock "cinder-62916507-3196-46a6-9ca6-54b027fdbd43-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Deleted volume successfully.
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5a3d7795-5fbe-434a-91a8-9591c97c270e tempest-VolumeImageDependencyTests-1006672786 None] Lock "cinder-779b5a56-bb07-4698-970b-0b8ab0895a4e-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Acquiring lock "cinder-quobyte-62916507-3196-46a6-9ca6-54b027fdbd43" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Lock "cinder-quobyte-62916507-3196-46a6-9ca6-54b027fdbd43" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f895461-4113-4b07-8217-aa083873a7ca]: (4, 'raw') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:15 devstack sudo[105535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43
Jul 14 18:09:15 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:16 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "cinder-54e307cf-d671-4650-b3a4-0930e01d7600-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43" returned: 0 in 0.420s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-54e307cf-d671-4650-b3a4-0930e01d7600-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "cinder-quobyte-54e307cf-d671-4650-b3a4-0930e01d7600" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-quobyte-54e307cf-d671-4650-b3a4-0930e01d7600" acquired by "delete_volume" :: waited 0.032s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0874d09d-4094-4173-b286-68b6e8fec870]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-54e307cf-d671-4650-b3a4-0930e01d7600 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:16 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43
Jul 14 18:09:16 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:16 devstack sudo[105540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-54e307cf-d671-4650-b3a4-0930e01d7600
Jul 14 18:09:16 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:16 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43" returned: 1 in 0.466s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43' failed. Not Retrying. {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:16 devstack sudo[105546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43
Jul 14 18:09:16 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:16 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-54e307cf-d671-4650-b3a4-0930e01d7600" returned: 0 in 0.495s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-54e307cf-d671-4650-b3a4-0930e01d7600 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:16 devstack sudo[105551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-54e307cf-d671-4650-b3a4-0930e01d7600
Jul 14 18:09:16 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:16 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-62916507-3196-46a6-9ca6-54b027fdbd43" returned: 0 in 0.332s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Lock "cinder-quobyte-62916507-3196-46a6-9ca6-54b027fdbd43" released by "delete_volume" :: held 1.291s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:16 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Created reservations ['5309b1d4-8a56-4cce-ad1c-45a9c5a84862', 'd7df14b9-7b82-4def-88d3-1f3b64ba1805', 'd51740f3-8e63-42b2-bb1a-6717bd1ba0da', 'e52ba061-afaa-45ca-945b-c8a471d30378'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:17 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-54e307cf-d671-4650-b3a4-0930e01d7600" returned: 0 in 0.369s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:17 devstack sudo[105555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:17 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-quobyte-54e307cf-d671-4650-b3a4-0930e01d7600" released by "delete_volume" :: held 0.933s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Created reservations ['75d90c30-3b9c-49cc-9686-b8dde8ac0c9e', '9586d459-30c6-4984-a10d-30970531d3bd', '4ce40634-5d91-4364-87e9-7d1777f3af9f', '195cac2d-63db-43ea-b54c-e24aa3944f35'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:17 devstack sudo[105557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:17 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:17 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.333s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:17 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Deleted volume successfully.
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dd70c758-b91a-4bd5-8a2b-2e1a9bad3664 tempest-VolumeAndVolumeTypeFromImageTest-301979342 None] Lock "cinder-62916507-3196-46a6-9ca6-54b027fdbd43-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:17 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.331s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:17 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Deleted volume successfully.
Jul 14 18:09:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c0e763d2-7a9e-42e1-8a41-9a3b6d117d98 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-54e307cf-d671-4650-b3a4-0930e01d7600-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "cinder-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "cinder-quobyte-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-quobyte-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:18 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1120b45e-a32b-47dc-b4c0-c72966b96de1]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:18 devstack sudo[105561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5
Jul 14 18:09:18 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:18 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5" returned: 0 in 0.425s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:18 devstack sudo[105567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5
Jul 14 18:09:18 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:19 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5" returned: 0 in 0.297s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-quobyte-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5" released by "delete_volume" :: held 0.777s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:19 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Created reservations ['8b08a250-b5a7-4853-872d-b8a867dbb5da', '279eb96c-95c6-40ae-b3b0-d4e1d3eb5446', '53cd2f3b-4054-4120-97cc-d80799ee835d', '419953b8-9cd7-4d1d-9f98-78afb550d6fd'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:19 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:19 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:19 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:19 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Deleted volume successfully.
Jul 14 18:09:19 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ca85793f-044c-47af-b2c4-fe1c73c9df15 tempest-CreateVolumesFromSourceVolumeTest-2047303608 None] Lock "cinder-15a0ce97-357e-4112-b8d3-bb5fbf4a32c5-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:09:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:20 devstack sudo[105574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:20 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:20 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:20 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Flow 'volume_create_manager' (cb94d912-33ac-4acd-9593-7cfaa4a1c2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afecae7-82fa-475c-855f-c278cce726b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afecae7-82fa-475c-855f-c278cce726b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c61000-3683-42e8-ac35-81ebde2574e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef003b2e44c94663bec7071376ddb1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:21Z,use_quota=True,user_id='5caad40ac16a4f3e8bd0818e52d6a592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c43aa5-3c2c-4b75-ba44-50dd1de2381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c43aa5-3c2c-4b75-ba44-50dd1de2381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd1bd0c-740c-41ff-8235-85f7224c78ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd1bd0c-740c-41ff-8235-85f7224c78ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c61000-3683-42e8-ac35-81ebde2574e3', 'volume_name': 'volume-56c61000-3683-42e8-ac35-81ebde2574e3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4530d424-2658-4aa0-97af-eb5844b2b756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4530d424-2658-4aa0-97af-eb5844b2b756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecb6c33-8061-4cf7-ba85-4d54fe1dc2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:21 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Volume 56c61000-3683-42e8-ac35-81ebde2574e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c61000-3683-42e8-ac35-81ebde2574e3', 'volume_size': 1}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c61000-3683-42e8-ac35-81ebde2574e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef003b2e44c94663bec7071376ddb1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:21Z,use_quota=True,user_id='5caad40ac16a4f3e8bd0818e52d6a592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Creating volume 56c61000-3683-42e8-ac35-81ebde2574e3 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:21 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-56c61000-3683-42e8-ac35-81ebde2574e3 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:21 devstack sudo[105576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-56c61000-3683-42e8-ac35-81ebde2574e3 1073741824
Jul 14 18:09:21 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:21 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.418s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:09:21 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-56c61000-3683-42e8-ac35-81ebde2574e3 1073741824" returned: 0 in 0.716s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-56c61000-3683-42e8-ac35-81ebde2574e3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:21 devstack sudo[105583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-56c61000-3683-42e8-ac35-81ebde2574e3
Jul 14 18:09:21 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:22 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-56c61000-3683-42e8-ac35-81ebde2574e3" returned: 0 in 0.346s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecb6c33-8061-4cf7-ba85-4d54fe1dc2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c61000-3683-42e8-ac35-81ebde2574e3', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977bd938-1899-4b0c-b734-3eb01f95e9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:22 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Volume volume-56c61000-3683-42e8-ac35-81ebde2574e3 (56c61000-3683-42e8-ac35-81ebde2574e3): created successfully
Jul 14 18:09:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977bd938-1899-4b0c-b734-3eb01f95e9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:22 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Flow 'volume_create_manager' (cb94d912-33ac-4acd-9593-7cfaa4a1c2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:22 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7bc62984-6b37-40c5-ae10-c1481b5a4162 tempest-CinderUnicodeTest-1454226746 None] Created volume successfully.
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Flow 'volume_create_manager' (c47181b8-2e53-441d-a2a9-c4b1dbd5b7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b1c27c-1acd-4496-aa24-dc3e3444e942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b1c27c-1acd-4496-aa24-dc3e3444e942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-588585093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b409cca-7c03-4dc9-91e7-70626760d483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef003b2e44c94663bec7071376ddb1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:23Z,use_quota=True,user_id='5caad40ac16a4f3e8bd0818e52d6a592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ab8553-6772-4339-8c01-ef92f80e7a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ab8553-6772-4339-8c01-ef92f80e7a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1bf50d-f7d0-4c2e-b410-1689d3595b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1bf50d-f7d0-4c2e-b410-1689d3595b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b409cca-7c03-4dc9-91e7-70626760d483', 'volume_name': 'volume-1b409cca-7c03-4dc9-91e7-70626760d483', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9d0af1-5af3-4886-804a-93bb2f9fd3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9d0af1-5af3-4886-804a-93bb2f9fd3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67721987-3818-458c-93bf-73a364ff825f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:23 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Volume 1b409cca-7c03-4dc9-91e7-70626760d483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b409cca-7c03-4dc9-91e7-70626760d483', 'volume_size': 1}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-588585093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b409cca-7c03-4dc9-91e7-70626760d483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef003b2e44c94663bec7071376ddb1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:23Z,use_quota=True,user_id='5caad40ac16a4f3e8bd0818e52d6a592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Creating volume 1b409cca-7c03-4dc9-91e7-70626760d483 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:23 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:23 devstack sudo[105586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483 1073741824
Jul 14 18:09:23 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Flow 'volume_create_manager' (c785e9f1-9962-4cd3-9e99-cf43f37aa40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757824fe-bf3b-478e-b735-bab67c5cb364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757824fe-bf3b-478e-b735-bab67c5cb364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-949294343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a4e8ab-5052-41b3-ae7a-c5540eef58d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271137716414413baf77102e67f232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:24Z,use_quota=True,user_id='a25c6df8695f46d4b2ac445ecab3cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c8e4a3-b758-4b24-990c-6ee54a4288ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:24 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c8e4a3-b758-4b24-990c-6ee54a4288ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519cb837-60e7-4723-bb57-ab28d1d33684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519cb837-60e7-4723-bb57-ab28d1d33684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9a4e8ab-5052-41b3-ae7a-c5540eef58d2', 'volume_name': 'volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5090422-77de-46b1-beac-376b2e841ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5090422-77de-46b1-beac-376b2e841ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b48c269-e704-4a43-a0ad-e0d8878a7a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:24 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume c9a4e8ab-5052-41b3-ae7a-c5540eef58d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2', 'volume_size': 1}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483 1073741824" returned: 0 in 0.669s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Flow 'volume_create_manager' (f1958a1c-5851-4859-acb8-35b3e7525d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b70198f-c657-455d-b366-72878384df8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b70198f-c657-455d-b366-72878384df8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1542289152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69709163-a3ee-4797-bd60-e18a3aa827bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2305d2cfc6cd491f841dd96f6a3b0ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:24Z,use_quota=True,user_id='0816ee91f9d34f27ad57ce914edc263d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1d58ee-86fb-4c75-babf-cce5ddc13157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1d58ee-86fb-4c75-babf-cce5ddc13157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5777da6c-dda0-473a-a3ad-e81303388aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5777da6c-dda0-473a-a3ad-e81303388aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69709163-a3ee-4797-bd60-e18a3aa827bd', 'volume_name': 'volume-69709163-a3ee-4797-bd60-e18a3aa827bd', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2042c1d6-607f-42d9-bdc5-3b77067805f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2042c1d6-607f-42d9-bdc5-3b77067805f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9b201f-935e-4558-bc7a-f1dfe70b5daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:24 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Volume 69709163-a3ee-4797-bd60-e18a3aa827bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69709163-a3ee-4797-bd60-e18a3aa827bd', 'volume_size': 1}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:24 devstack sudo[105591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483
Jul 14 18:09:24 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:24 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.382s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-949294343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a4e8ab-5052-41b3-ae7a-c5540eef58d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271137716414413baf77102e67f232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:24Z,use_quota=True,user_id='a25c6df8695f46d4b2ac445ecab3cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Creating volume c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:24 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:24 devstack sudo[105594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 1073741824
Jul 14 18:09:24 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67721987-3818-458c-93bf-73a364ff825f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b409cca-7c03-4dc9-91e7-70626760d483', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95f019b-95c3-403e-b24b-bc6eebda6c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:24 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Volume volume-1b409cca-7c03-4dc9-91e7-70626760d483 (1b409cca-7c03-4dc9-91e7-70626760d483): created successfully
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95f019b-95c3-403e-b24b-bc6eebda6c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:24 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Flow 'volume_create_manager' (c47181b8-2e53-441d-a2a9-c4b1dbd5b7a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c3e661a7-4845-4c95-8b42-f060eae9058b tempest-CinderUnicodeTest-1454226746 None] Created volume successfully.
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:25 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 1073741824" returned: 0 in 0.574s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:25 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2
Jul 14 18:09:25 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:25 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2" returned: 0 in 0.259s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1542289152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69709163-a3ee-4797-bd60-e18a3aa827bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2305d2cfc6cd491f841dd96f6a3b0ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:24Z,use_quota=True,user_id='0816ee91f9d34f27ad57ce914edc263d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Creating volume 69709163-a3ee-4797-bd60-e18a3aa827bd {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:25 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:25 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd 1073741824
Jul 14 18:09:25 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b48c269-e704-4a43-a0ad-e0d8878a7a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06978fc5-f9eb-4148-b66e-40dbcbe2eedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:25 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 (c9a4e8ab-5052-41b3-ae7a-c5540eef58d2): created successfully
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06978fc5-f9eb-4148-b66e-40dbcbe2eedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Flow 'volume_create_manager' (c785e9f1-9962-4cd3-9e99-cf43f37aa40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4f04e4c7-1d24-472f-bfbb-05022f19c745 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created volume successfully.
Jul 14 18:09:26 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd 1073741824" returned: 0 in 0.449s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:26 devstack sudo[105609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd
Jul 14 18:09:26 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:26 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd" returned: 0 in 0.291s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.132s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9b201f-935e-4558-bc7a-f1dfe70b5daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69709163-a3ee-4797-bd60-e18a3aa827bd', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f256ea-cecc-4c88-86fc-78b0bae89826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] Creating offline snapshot 876a6427-8980-4292-a141-fa51c4859dfc of volume 1b409cca-7c03-4dc9-91e7-70626760d483 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:09:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Volume volume-69709163-a3ee-4797-bd60-e18a3aa827bd (69709163-a3ee-4797-bd60-e18a3aa827bd): created successfully
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f256ea-cecc-4c88-86fc-78b0bae89826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Flow 'volume_create_manager' (f1958a1c-5851-4859-acb8-35b3e7525d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee2fbb1-7334-4415-9d36-a4bdb81eb4c8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6728545c-e6a0-4220-aa10-e449624ee262 tempest-VolumeDependencyTests-587201018 None] Created volume successfully.
Jul 14 18:09:26 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483
Jul 14 18:09:26 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:26 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483" returned: 0 in 0.378s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:26 devstack sudo[105617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc 1G
Jul 14 18:09:26 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:27 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc 1G" returned: 0 in 0.449s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b409cca-7c03-4dc9-91e7-70626760d483 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:27 devstack sudo[105623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b409cca-7c03-4dc9-91e7-70626760d483 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc
Jul 14 18:09:27 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:27 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b409cca-7c03-4dc9-91e7-70626760d483 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:27 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc is being set with open permissions: ugo+rw
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:27 devstack sudo[105629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc
Jul 14 18:09:27 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Flow 'volume_create_manager' (b67d3928-ce40-4cfb-bd6b-88374277e7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4ebabc-46f5-4a51-81c0-1713e18481e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4ebabc-46f5-4a51-81c0-1713e18481e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045128804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5715e659-8916-4165-9af0-d28844aaa196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab45f362a704b80bca31b165f3ce0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:28Z,use_quota=True,user_id='d59613b6463842ea84242b9e3506c485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8cda13c-f897-44c7-abb8-a0c21669c72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8cda13c-f897-44c7-abb8-a0c21669c72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b587ae5-5635-472b-bb79-194c29e39020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b587ae5-5635-472b-bb79-194c29e39020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5715e659-8916-4165-9af0-d28844aaa196', 'volume_name': 'volume-5715e659-8916-4165-9af0-d28844aaa196', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b66c86-5c4a-4ee1-9883-b8e8abf997a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b66c86-5c4a-4ee1-9883-b8e8abf997a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fb6cf4-a143-4386-ab72-a8d4bd789df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:27 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Volume 5715e659-8916-4165-9af0-d28844aaa196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5715e659-8916-4165-9af0-d28844aaa196', 'volume_size': 1}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:27 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc" returned: 0 in 0.263s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:27 devstack sudo[105632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.info
Jul 14 18:09:27 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:28 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.info" returned: 0 in 0.261s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:28 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.info is being set with open permissions: ugo+rw
Jul 14 18:09:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:28 devstack sudo[105635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.info
Jul 14 18:09:28 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:28 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.info" returned: 0 in 0.268s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.096s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:28 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] Creating offline snapshot e39255b7-b2c2-4d66-8504-1bafd3ba3eec of volume c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:09:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-004de4b9-dd4b-452e-ac80-84ad7959d1c6 tempest-CinderUnicodeTest-1454226746 None] Create snapshot completed successfully
Jul 14 18:09:28 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0ef4da-8ff3-4416-b21a-e411a022eea8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:28 devstack sudo[105638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2
Jul 14 18:09:28 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:28 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:28 devstack sudo[105643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec 1G
Jul 14 18:09:28 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:29 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec 1G" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:29 devstack sudo[105648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec
Jul 14 18:09:29 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:29 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "cinder-876a6427-8980-4292-a141-fa51c4859dfc-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec" returned: 0 in 0.315s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:29 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec is being set with open permissions: ugo+rw
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-876a6427-8980-4292-a141-fa51c4859dfc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "cinder-quobyte-1b409cca-7c03-4dc9-91e7-70626760d483" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:29 devstack sudo[105653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec
Jul 14 18:09:29 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-quobyte-1b409cca-7c03-4dc9-91e7-70626760d483" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "cinder-quobyte-876a6427-8980-4292-a141-fa51c4859dfc" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-quobyte-876a6427-8980-4292-a141-fa51c4859dfc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Deleting offline snapshot 876a6427-8980-4292-a141-fa51c4859dfc of volume 1b409cca-7c03-4dc9-91e7-70626760d483 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] snapshot_file for this snap is: volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19f538e-7f59-4598-9009-17be71172078]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:29 devstack sudo[105655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc
Jul 14 18:09:29 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:29 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec" returned: 0 in 0.266s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:29 devstack sudo[105659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.info
Jul 14 18:09:29 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:30 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc" returned: 0 in 0.359s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b409cca-7c03-4dc9-91e7-70626760d483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff15e61-ba17-439c-bbcb-3a86d3bf2526]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:30 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:30 devstack sudo[105664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483
Jul 14 18:09:30 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.info" returned: 0 in 0.283s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:30 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.info is being set with open permissions: ugo+rw
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:30 devstack sudo[105667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.info
Jul 14 18:09:30 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:30 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.info" returned: 0 in 0.251s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:30 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.982s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483" returned: 0 in 0.392s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] Creating offline snapshot bc2d69e1-326e-435e-9ff7-c6d8e888981f of volume 69709163-a3ee-4797-bd60-e18a3aa827bd {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:09:30 devstack sudo[105673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc
Jul 14 18:09:30 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b4c4d5-db33-4bd2-95e8-cd667a839815]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d8c1aa4b-185e-49c7-a556-33676238f6ea tempest-CreateVolumesFromSnapshotTest-1503989656 None] Create snapshot completed successfully
Jul 14 18:09:30 devstack sudo[105675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd
Jul 14 18:09:30 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:30 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc" returned: 0 in 0.373s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:30 devstack sudo[105680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc
Jul 14 18:09:30 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:30 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd" returned: 0 in 0.421s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:30 devstack sudo[105685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f 1G
Jul 14 18:09:30 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:31 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483.876a6427-8980-4292-a141-fa51c4859dfc" returned: 0 in 0.265s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-quobyte-876a6427-8980-4292-a141-fa51c4859dfc" released by "_delete_snapshot" :: held 1.492s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-quobyte-1b409cca-7c03-4dc9-91e7-70626760d483" released by "delete_snapshot" :: held 1.517s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Created reservations ['cd86cafa-fcff-4aa8-84c0-59a7242e406f', '04e013ce-d374-4517-b631-18510b3a50b6', '9ee4b6da-4647-47a2-b212-102460c34d7e', 'df8eb7e6-38fb-4f25-a6ed-330dd7a187b0'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Delete snapshot completed successfully.
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-481a63c1-1fa6-4630-90ac-3ddd1b42354d tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-876a6427-8980-4292-a141-fa51c4859dfc-delete_snapshot" released by "delete_snapshot" :: held 1.665s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:31 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f 1G" returned: 0 in 0.460s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69709163-a3ee-4797-bd60-e18a3aa827bd -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:31 devstack sudo[105691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69709163-a3ee-4797-bd60-e18a3aa827bd -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f
Jul 14 18:09:31 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:31 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69709163-a3ee-4797-bd60-e18a3aa827bd -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:31 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f is being set with open permissions: ugo+rw
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "cinder-1b409cca-7c03-4dc9-91e7-70626760d483-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:31 devstack sudo[105697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f
Jul 14 18:09:31 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-1b409cca-7c03-4dc9-91e7-70626760d483-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "cinder-quobyte-1b409cca-7c03-4dc9-91e7-70626760d483" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-quobyte-1b409cca-7c03-4dc9-91e7-70626760d483" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b25edb-9148-40b0-a5ac-ca2fdbff8d15]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:32 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:32 devstack sudo[105699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483
Jul 14 18:09:32 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:32 devstack sudo[105702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.info
Jul 14 18:09:32 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Flow 'volume_create_manager' (7a3dcbfe-fdf2-4e83-aa63-329f5b19d5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1be5f0-3bf0-48bc-b410-cf196d39af29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1be5f0-3bf0-48bc-b410-cf196d39af29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1731477349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea584e9-461a-4ef3-9734-4d7d0868960f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271137716414413baf77102e67f232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:32Z,use_quota=True,user_id='a25c6df8695f46d4b2ac445ecab3cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe165036-d57f-4c1c-85ba-413adcb413ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe165036-d57f-4c1c-85ba-413adcb413ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca40397-0ba7-4ab8-a4d9-ab5a6f60b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca40397-0ba7-4ab8-a4d9-ab5a6f60b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea584e9-461a-4ef3-9734-4d7d0868960f', 'volume_name': 'volume-8ea584e9-461a-4ef3-9734-4d7d0868960f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ee623d-a5b9-4d6d-8631-94e67997cced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ee623d-a5b9-4d6d-8631-94e67997cced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e648b132-f036-4807-90bc-25eb36c8575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:32 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume 8ea584e9-461a-4ef3-9734-4d7d0868960f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea584e9-461a-4ef3-9734-4d7d0868960f', 'volume_size': 1}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:32 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483" returned: 0 in 0.456s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:32 devstack sudo[105707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483
Jul 14 18:09:32 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:32 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.info" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:32 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.info is being set with open permissions: ugo+rw
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:32 devstack sudo[105710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.info
Jul 14 18:09:32 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Flow 'volume_create_manager' (2be2477d-dfec-4f8c-843a-e69c98bc3516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3509c6fe-4665-4309-8f27-f829bf16b34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3509c6fe-4665-4309-8f27-f829bf16b34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1001933667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d521df8-9db3-4708-a55f-7fffca18783e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271137716414413baf77102e67f232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:33Z,use_quota=True,user_id='a25c6df8695f46d4b2ac445ecab3cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5041bb9d-97de-474c-a733-a75965b4279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5041bb9d-97de-474c-a733-a75965b4279b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0e70a1-8fb1-45eb-a1b8-121fc36f9b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0e70a1-8fb1-45eb-a1b8-121fc36f9b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d521df8-9db3-4708-a55f-7fffca18783e', 'volume_name': 'volume-5d521df8-9db3-4708-a55f-7fffca18783e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccb5378-1522-429b-8494-ac6f551d3fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccb5378-1522-429b-8494-ac6f551d3fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e4ea89-3eb0-4226-9b7a-4263ab913c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:32 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume 5d521df8-9db3-4708-a55f-7fffca18783e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d521df8-9db3-4708-a55f-7fffca18783e', 'volume_size': 1}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:32 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-1b409cca-7c03-4dc9-91e7-70626760d483" returned: 0 in 0.363s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-quobyte-1b409cca-7c03-4dc9-91e7-70626760d483" released by "delete_volume" :: held 0.900s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:32 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.info" returned: 0 in 0.382s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.425s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045128804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5715e659-8916-4165-9af0-d28844aaa196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab45f362a704b80bca31b165f3ce0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:28Z,use_quota=True,user_id='d59613b6463842ea84242b9e3506c485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Creating volume 5715e659-8916-4165-9af0-d28844aaa196 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:32 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5715e659-8916-4165-9af0-d28844aaa196 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:32 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Created reservations ['99b6d139-de1a-41cc-9408-2430c08238f1', 'c2f1fc02-570a-4189-88f5-fc8c8196215b', '7712758f-7f41-404a-be1a-79899c867cf9', '5fb17d99-563b-444d-97fd-418cb6ec6c56'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:32 devstack sudo[105714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5715e659-8916-4165-9af0-d28844aaa196 1073741824
Jul 14 18:09:32 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-aabaea9f-846b-48df-8dfe-4ece5b2c3c9e tempest-VolumeDependencyTests-587201018 None] Create snapshot completed successfully
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:33 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:33 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Flow 'volume_create_manager' (c28a48e5-b449-4c5a-a19e-e9986c115970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faceebf8-4cd8-4f5b-8eeb-f7eb2a79fae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faceebf8-4cd8-4f5b-8eeb-f7eb2a79fae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-267507762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c0f128-e8b7-4dc2-8f12-7d62061d34a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271137716414413baf77102e67f232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:33Z,use_quota=True,user_id='a25c6df8695f46d4b2ac445ecab3cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f81930-40d6-448c-b78c-817ae7c7a2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f81930-40d6-448c-b78c-817ae7c7a2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4812528-9e46-4e5a-a9d7-e484f78a0f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4812528-9e46-4e5a-a9d7-e484f78a0f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c0f128-e8b7-4dc2-8f12-7d62061d34a2', 'volume_name': 'volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d611fb-18af-4f15-bcf6-77573c84d0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d611fb-18af-4f15-bcf6-77573c84d0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09d49b8-45fe-4a19-9356-b5612f2310ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume b6c0f128-e8b7-4dc2-8f12-7d62061d34a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2', 'volume_size': 1}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:33 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.398s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Deleted volume successfully.
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-13ff7207-bcac-4330-80bf-81a0a8a5d0d9 tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-1b409cca-7c03-4dc9-91e7-70626760d483-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:33 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Flow 'volume_create_manager' (921f67c2-d498-440b-a18b-c002a20744d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e05cdb0-1cfd-4872-83a1-7dc1adc60308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5715e659-8916-4165-9af0-d28844aaa196 1073741824" returned: 0 in 0.665s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e05cdb0-1cfd-4872-83a1-7dc1adc60308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1381122797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26966e03-a757-460d-91f8-11ffb64b86e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271137716414413baf77102e67f232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:33Z,use_quota=True,user_id='a25c6df8695f46d4b2ac445ecab3cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c468e4-feb5-453a-a094-8fcde9316472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c468e4-feb5-453a-a094-8fcde9316472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95da5ab6-4e28-43ab-8060-7d546fd1c777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95da5ab6-4e28-43ab-8060-7d546fd1c777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26966e03-a757-460d-91f8-11ffb64b86e2', 'volume_name': 'volume-26966e03-a757-460d-91f8-11ffb64b86e2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b187924d-6e47-4f7c-8c00-4822c6e1ce7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b187924d-6e47-4f7c-8c00-4822c6e1ce7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e194a2e9-b6ac-4c78-8642-7c7d39b74a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume 26966e03-a757-460d-91f8-11ffb64b86e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26966e03-a757-460d-91f8-11ffb64b86e2', 'volume_size': 1}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5715e659-8916-4165-9af0-d28844aaa196 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:33 devstack sudo[105723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5715e659-8916-4165-9af0-d28844aaa196
Jul 14 18:09:33 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:33 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5715e659-8916-4165-9af0-d28844aaa196" returned: 0 in 0.331s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.654s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1731477349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea584e9-461a-4ef3-9734-4d7d0868960f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271137716414413baf77102e67f232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:32Z,use_quota=True,user_id='a25c6df8695f46d4b2ac445ecab3cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Creating volume 8ea584e9-461a-4ef3-9734-4d7d0868960f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:33 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8ea584e9-461a-4ef3-9734-4d7d0868960f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fb6cf4-a143-4386-ab72-a8d4bd789df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5715e659-8916-4165-9af0-d28844aaa196', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337257c5-ca7a-480f-a3fb-eb957c8049e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:34 devstack sudo[105726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8ea584e9-461a-4ef3-9734-4d7d0868960f 1073741824
Jul 14 18:09:34 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Flow 'volume_create_manager' (09fb8643-7d74-4a41-be7d-971e1763c932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08383f2-582a-4ac9-842d-bba9adca4643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "cinder-56c61000-3683-42e8-ac35-81ebde2574e3-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:34 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Volume volume-5715e659-8916-4165-9af0-d28844aaa196 (5715e659-8916-4165-9af0-d28844aaa196): created successfully
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337257c5-ca7a-480f-a3fb-eb957c8049e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Flow 'volume_create_manager' (b67d3928-ce40-4cfb-bd6b-88374277e7c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08383f2-582a-4ac9-842d-bba9adca4643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1412594322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bd2b8e-731e-49fd-895c-adc2014087d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271137716414413baf77102e67f232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:34Z,use_quota=True,user_id='a25c6df8695f46d4b2ac445ecab3cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e56766c-fd77-4827-8929-7b936885680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e56766c-fd77-4827-8929-7b936885680e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d749280-da51-4bb5-a4c9-91776ec3577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d749280-da51-4bb5-a4c9-91776ec3577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46bd2b8e-731e-49fd-895c-adc2014087d8', 'volume_name': 'volume-46bd2b8e-731e-49fd-895c-adc2014087d8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b840bb44-7fef-403f-a519-142f7c35b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b840bb44-7fef-403f-a519-142f7c35b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0261fe22-a3a2-4a88-b153-c255260ded73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:34 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume 46bd2b8e-731e-49fd-895c-adc2014087d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46bd2b8e-731e-49fd-895c-adc2014087d8', 'volume_size': 1}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-56c61000-3683-42e8-ac35-81ebde2574e3-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4fdace46-84da-4fd7-aa25-44063fbcce71 tempest-ProjectReaderTests-560304223 None] Created volume successfully.
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "cinder-quobyte-56c61000-3683-42e8-ac35-81ebde2574e3" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-quobyte-56c61000-3683-42e8-ac35-81ebde2574e3" acquired by "delete_volume" :: waited 0.039s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c45dd5-e670-49ec-954f-d51df4436480]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-56c61000-3683-42e8-ac35-81ebde2574e3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:34 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-56c61000-3683-42e8-ac35-81ebde2574e3
Jul 14 18:09:34 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Flow 'volume_create_manager' (89c30c8c-67c6-4c53-a21c-c9631c307800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478b0c00-eb8e-4e10-9c34-6c22758dc554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478b0c00-eb8e-4e10-9c34-6c22758dc554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1506923382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5582d503-f7ac-4595-8a29-687441bca587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2305d2cfc6cd491f841dd96f6a3b0ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bc2d69e1-326e-435e-9ff7-c6d8e888981f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:34Z,use_quota=True,user_id='0816ee91f9d34f27ad57ce914edc263d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dccf4e71-9a42-40bd-97fd-d3c1dd40a5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dccf4e71-9a42-40bd-97fd-d3c1dd40a5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d3a82e-c242-44d3-b4ca-4f87514ee48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d3a82e-c242-44d3-b4ca-4f87514ee48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5582d503-f7ac-4595-8a29-687441bca587', 'volume_name': 'volume-5582d503-f7ac-4595-8a29-687441bca587', 'volume_size': 1, 'snapshot_id': 'bc2d69e1-326e-435e-9ff7-c6d8e888981f'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e6ad00-5fb4-4b39-86bd-727c25a8a757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e6ad00-5fb4-4b39-86bd-727c25a8a757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4a3586-6c89-44f1-863a-b63f538ea101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:34 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Volume 5582d503-f7ac-4595-8a29-687441bca587: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5582d503-f7ac-4595-8a29-687441bca587', 'volume_size': 1, 'snapshot_id': 'bc2d69e1-326e-435e-9ff7-c6d8e888981f'}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Acquiring lock "cinder-5715e659-8916-4165-9af0-d28844aaa196-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Lock "cinder-5715e659-8916-4165-9af0-d28844aaa196-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:34 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8ea584e9-461a-4ef3-9734-4d7d0868960f 1073741824" returned: 0 in 0.642s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Acquiring lock "cinder-quobyte-5715e659-8916-4165-9af0-d28844aaa196" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8ea584e9-461a-4ef3-9734-4d7d0868960f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:34 devstack sudo[105736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8ea584e9-461a-4ef3-9734-4d7d0868960f
Jul 14 18:09:34 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Lock "cinder-quobyte-5715e659-8916-4165-9af0-d28844aaa196" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fece2e3-c546-4bf0-b9ca-1348b7154c4b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5715e659-8916-4165-9af0-d28844aaa196 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:34 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-56c61000-3683-42e8-ac35-81ebde2574e3" returned: 0 in 0.407s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-56c61000-3683-42e8-ac35-81ebde2574e3 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:34 devstack sudo[105740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-56c61000-3683-42e8-ac35-81ebde2574e3
Jul 14 18:09:34 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:34 devstack sudo[105739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5715e659-8916-4165-9af0-d28844aaa196
Jul 14 18:09:34 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:34 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8ea584e9-461a-4ef3-9734-4d7d0868960f" returned: 0 in 0.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.222s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1001933667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d521df8-9db3-4708-a55f-7fffca18783e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271137716414413baf77102e67f232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:33Z,use_quota=True,user_id='a25c6df8695f46d4b2ac445ecab3cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Creating volume 5d521df8-9db3-4708-a55f-7fffca18783e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:34 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5d521df8-9db3-4708-a55f-7fffca18783e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e648b132-f036-4807-90bc-25eb36c8575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea584e9-461a-4ef3-9734-4d7d0868960f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b669fd-c50f-4101-bc34-53a59c8b7c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:35 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:35 devstack sudo[105745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5d521df8-9db3-4708-a55f-7fffca18783e 1073741824
Jul 14 18:09:35 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-56c61000-3683-42e8-ac35-81ebde2574e3" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-quobyte-56c61000-3683-42e8-ac35-81ebde2574e3" released by "delete_volume" :: held 0.720s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:35 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume volume-8ea584e9-461a-4ef3-9734-4d7d0868960f (8ea584e9-461a-4ef3-9734-4d7d0868960f): created successfully
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b669fd-c50f-4101-bc34-53a59c8b7c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Flow 'volume_create_manager' (7a3dcbfe-fdf2-4e83-aa63-329f5b19d5a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-24c54e8d-de63-428d-afb9-3e5b665ab916 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created volume successfully.
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Created reservations ['6e00c7ee-7a14-47ea-8fa6-db980509885f', '4e1a3580-bc4d-40f8-acf4-eed491306bdb', '2be6caba-6752-4b0a-bbb6-8c7acbc30238', '68dfe2f9-1604-4218-9331-219e641c1ea8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:35 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5715e659-8916-4165-9af0-d28844aaa196" returned: 0 in 0.426s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5715e659-8916-4165-9af0-d28844aaa196 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:35 devstack sudo[105750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5715e659-8916-4165-9af0-d28844aaa196
Jul 14 18:09:35 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:35 devstack sudo[105754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:35 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:35 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5715e659-8916-4165-9af0-d28844aaa196" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:35 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5d521df8-9db3-4708-a55f-7fffca18783e 1073741824" returned: 0 in 0.531s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Lock "cinder-quobyte-5715e659-8916-4165-9af0-d28844aaa196" released by "delete_volume" :: held 0.818s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:35 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.312s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Deleted volume successfully.
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5d521df8-9db3-4708-a55f-7fffca18783e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c2301601-3807-4910-b93f-96c9ed079633 tempest-CinderUnicodeTest-1454226746 None] Lock "cinder-56c61000-3683-42e8-ac35-81ebde2574e3-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:35 devstack sudo[105760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5d521df8-9db3-4708-a55f-7fffca18783e
Jul 14 18:09:35 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Created reservations ['ded1ff2a-4191-4062-aa0a-68df8e9d703e', '4b9a88a2-4234-4d52-ba6c-a9803666b6cf', '9fa1f41e-5876-484b-b8e5-b232cb1fd46d', 'ca8051ac-8df4-4ac7-8afc-6991ae7564cd'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:35 devstack sudo[105762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:35 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:35 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5d521df8-9db3-4708-a55f-7fffca18783e" returned: 0 in 0.280s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.639s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-267507762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c0f128-e8b7-4dc2-8f12-7d62061d34a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271137716414413baf77102e67f232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:33Z,use_quota=True,user_id='a25c6df8695f46d4b2ac445ecab3cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Creating volume b6c0f128-e8b7-4dc2-8f12-7d62061d34a2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:35 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:35 devstack sudo[105765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2 1073741824
Jul 14 18:09:35 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e4ea89-3eb0-4226-9b7a-4263ab913c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d521df8-9db3-4708-a55f-7fffca18783e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937fd020-03c0-4f1b-b7e5-570efdd77d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:35 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume volume-5d521df8-9db3-4708-a55f-7fffca18783e (5d521df8-9db3-4708-a55f-7fffca18783e): created successfully
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937fd020-03c0-4f1b-b7e5-570efdd77d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:35 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Flow 'volume_create_manager' (2be2477d-dfec-4f8c-843a-e69c98bc3516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-da836e0d-8147-43a9-8bd2-a3b5fd3c02b2 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created volume successfully.
Jul 14 18:09:36 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.313s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Deleted volume successfully.
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-5895e12c-3599-47f4-9e4d-33beaa7a4ae1 tempest-ProjectReaderTests-560304223 None] Lock "cinder-5715e659-8916-4165-9af0-d28844aaa196-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Flow 'volume_create_manager' (6c41d45f-8e76-4833-91ae-a3ca9640a86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec83d00-d11c-4ee8-90d5-164334fdd5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec83d00-d11c-4ee8-90d5-164334fdd5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512231208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dcd45c-defb-4827-8ed5-20ef396f23e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab45f362a704b80bca31b165f3ce0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:36Z,use_quota=True,user_id='d59613b6463842ea84242b9e3506c485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edaaf10d-5d16-4da9-abda-4a63e79ae5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edaaf10d-5d16-4da9-abda-4a63e79ae5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89fc3ae-79bf-4cc9-91f0-3376b08c5134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89fc3ae-79bf-4cc9-91f0-3376b08c5134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35dcd45c-defb-4827-8ed5-20ef396f23e2', 'volume_name': 'volume-35dcd45c-defb-4827-8ed5-20ef396f23e2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024647a1-080c-4b73-b745-26e3eade725b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024647a1-080c-4b73-b745-26e3eade725b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:36 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2a75c8-6fb7-4ea1-8688-9f7872b99eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:36 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Volume 35dcd45c-defb-4827-8ed5-20ef396f23e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35dcd45c-defb-4827-8ed5-20ef396f23e2', 'volume_size': 1}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2 1073741824" returned: 0 in 0.675s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:36 devstack sudo[105772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2
Jul 14 18:09:36 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:36 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2" returned: 0 in 0.257s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.238s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1381122797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26966e03-a757-460d-91f8-11ffb64b86e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271137716414413baf77102e67f232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:33Z,use_quota=True,user_id='a25c6df8695f46d4b2ac445ecab3cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Creating volume 26966e03-a757-460d-91f8-11ffb64b86e2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:36 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26966e03-a757-460d-91f8-11ffb64b86e2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09d49b8-45fe-4a19-9356-b5612f2310ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:36 devstack sudo[105775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26966e03-a757-460d-91f8-11ffb64b86e2 1073741824
Jul 14 18:09:36 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071db6b0-832b-45d6-8757-bac644fd2316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:36 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2 (b6c0f128-e8b7-4dc2-8f12-7d62061d34a2): created successfully
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071db6b0-832b-45d6-8757-bac644fd2316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:36 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Flow 'volume_create_manager' (c28a48e5-b449-4c5a-a19e-e9986c115970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7dbb1975-9042-4e7c-bec6-3914acf71ba7 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created volume successfully.
Jul 14 18:09:37 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26966e03-a757-460d-91f8-11ffb64b86e2 1073741824" returned: 0 in 0.512s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26966e03-a757-460d-91f8-11ffb64b86e2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:37 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26966e03-a757-460d-91f8-11ffb64b86e2
Jul 14 18:09:37 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:37 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26966e03-a757-460d-91f8-11ffb64b86e2" returned: 0 in 0.263s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.465s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1412594322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46bd2b8e-731e-49fd-895c-adc2014087d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271137716414413baf77102e67f232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:34Z,use_quota=True,user_id='a25c6df8695f46d4b2ac445ecab3cbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Creating volume 46bd2b8e-731e-49fd-895c-adc2014087d8 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:37 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-46bd2b8e-731e-49fd-895c-adc2014087d8 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:37 devstack sudo[105784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-46bd2b8e-731e-49fd-895c-adc2014087d8 1073741824
Jul 14 18:09:37 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e194a2e9-b6ac-4c78-8642-7c7d39b74a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26966e03-a757-460d-91f8-11ffb64b86e2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f38c74-9db7-4df2-82fc-bf13e5126d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:37 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume volume-26966e03-a757-460d-91f8-11ffb64b86e2 (26966e03-a757-460d-91f8-11ffb64b86e2): created successfully
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f38c74-9db7-4df2-82fc-bf13e5126d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:37 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Flow 'volume_create_manager' (921f67c2-d498-440b-a18b-c002a20744d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-88b72b25-1ec6-437c-9dfd-24c446f522ca tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created volume successfully.
Jul 14 18:09:38 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-46bd2b8e-731e-49fd-895c-adc2014087d8 1073741824" returned: 0 in 0.480s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-46bd2b8e-731e-49fd-895c-adc2014087d8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:38 devstack sudo[105790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-46bd2b8e-731e-49fd-895c-adc2014087d8
Jul 14 18:09:38 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:38 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-46bd2b8e-731e-49fd-895c-adc2014087d8" returned: 0 in 0.325s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.920s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Acquiring lock "cinder-quobyte-bc2d69e1-326e-435e-9ff7-c6d8e888981f-5582d503-f7ac-4595-8a29-687441bca587" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0261fe22-a3a2-4a88-b153-c255260ded73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46bd2b8e-731e-49fd-895c-adc2014087d8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9f91fe-0ae0-4d5a-9da7-e6b0d7ab50fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Lock "cinder-quobyte-bc2d69e1-326e-435e-9ff7-c6d8e888981f-5582d503-f7ac-4595-8a29-687441bca587" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Creating volume 5582d503-f7ac-4595-8a29-687441bca587 from snapshot bc2d69e1-326e-435e-9ff7-c6d8e888981f {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Acquiring lock "cinder-quobyte-5582d503-f7ac-4595-8a29-687441bca587" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:38 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Volume volume-46bd2b8e-731e-49fd-895c-adc2014087d8 (46bd2b8e-731e-49fd-895c-adc2014087d8): created successfully
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9f91fe-0ae0-4d5a-9da7-e6b0d7ab50fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Flow 'volume_create_manager' (09fb8643-7d74-4a41-be7d-971e1763c932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Lock "cinder-quobyte-5582d503-f7ac-4595-8a29-687441bca587" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] snapshot: bc2d69e1-326e-435e-9ff7-c6d8e888981f, volume: 5582d503-f7ac-4595-8a29-687441bca587,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-836c311e-4270-48c1-85e6-35b7d1ccbccb tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created volume successfully.
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3ad79e-0769-461d-bd2d-3376ad81c8f5]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:38 devstack sudo[105793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f
Jul 14 18:09:38 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:39 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f" returned: 0 in 0.382s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69709163-a3ee-4797-bd60-e18a3aa827bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3867c05-92e2-45d1-b1d5-322529303dfa]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:39 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd
Jul 14 18:09:39 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:39 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd" returned: 0 in 0.379s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Path /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:39 devstack sudo[105803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587
Jul 14 18:09:39 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-46bd2b8e-731e-49fd-895c-adc2014087d8-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-46bd2b8e-731e-49fd-895c-adc2014087d8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-quobyte-46bd2b8e-731e-49fd-895c-adc2014087d8" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-46bd2b8e-731e-49fd-895c-adc2014087d8" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e0b283-f14a-4d8b-9360-8cc1cf9e942f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-46bd2b8e-731e-49fd-895c-adc2014087d8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:39 devstack sudo[105809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-46bd2b8e-731e-49fd-895c-adc2014087d8
Jul 14 18:09:39 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:40 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-46bd2b8e-731e-49fd-895c-adc2014087d8" returned: 0 in 0.688s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-46bd2b8e-731e-49fd-895c-adc2014087d8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:40 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-46bd2b8e-731e-49fd-895c-adc2014087d8
Jul 14 18:09:40 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:41 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-46bd2b8e-731e-49fd-895c-adc2014087d8" returned: 0 in 0.620s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:41 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-46bd2b8e-731e-49fd-895c-adc2014087d8" released by "delete_volume" :: held 1.380s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:41 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created reservations ['cd30c49b-c596-403e-993b-94ef95cfbc73', '9d72cb04-4a74-4812-a181-984ec5da9e60', '18d6266b-f567-4596-8523-0425afc3abca', '4b88c188-2970-4a0d-a811-e61ff2c4a519'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:41 devstack sudo[105825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:41 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:42 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.674s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:42 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:42 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Deleted volume successfully.
Jul 14 18:09:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-26966e03-a757-460d-91f8-11ffb64b86e2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-26966e03-a757-460d-91f8-11ffb64b86e2-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3ea41b58-4a59-4b48-bfd7-861dc6729348 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-46bd2b8e-731e-49fd-895c-adc2014087d8-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-quobyte-26966e03-a757-460d-91f8-11ffb64b86e2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:42 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-26966e03-a757-460d-91f8-11ffb64b86e2" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:42 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d7d3dd-6aed-461b-958b-18db422721e0]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26966e03-a757-460d-91f8-11ffb64b86e2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:42 devstack sudo[105832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26966e03-a757-460d-91f8-11ffb64b86e2
Jul 14 18:09:42 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:43 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26966e03-a757-460d-91f8-11ffb64b86e2" returned: 0 in 0.964s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26966e03-a757-460d-91f8-11ffb64b86e2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:43 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26966e03-a757-460d-91f8-11ffb64b86e2
Jul 14 18:09:43 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:44 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-26966e03-a757-460d-91f8-11ffb64b86e2" returned: 0 in 0.517s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-26966e03-a757-460d-91f8-11ffb64b86e2" released by "delete_volume" :: held 1.582s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:44 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created reservations ['416b2b48-55cd-476b-befe-b09ef4676fb5', '572c0304-38ed-416d-9f98-63a02fe5f0fd', '08e56cf4-2c40-407e-996c-7440e9299b75', '9ab61984-45f2-4bba-ac9d-7d915bdd2e15'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:44 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:44 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:44 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-quobyte-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2" acquired by "delete_volume" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31ce465-a872-4c43-bf15-906aad82ff0b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:45 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.743s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Deleted volume successfully.
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-36ba05ae-5cd9-4079-be07-424e5ffdc906 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-26966e03-a757-460d-91f8-11ffb64b86e2-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:45 devstack sudo[105876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2
Jul 14 18:09:45 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:45 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587" returned: 0 in 5.872s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacb9b13-e268-4eb1-9102-9eb69c0a4154]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:45 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd
Jul 14 18:09:45 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:45 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2" returned: 0 in 0.488s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:45 devstack sudo[105883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2
Jul 14 18:09:45 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:45 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2" returned: 0 in 0.244s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2" released by "delete_volume" :: held 0.809s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created reservations ['f591d8d6-2b1f-46e2-835d-452b6e6b9ec0', '56cbaf62-a38a-4de4-8e3a-a061b36d266f', '4071b6bb-0873-4f00-94e0-8f14bd0a389c', '46803375-805b-458c-b7a4-043dfde7b6af'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:45 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd" returned: 0 in 0.588s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:09:45 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Converted 1024.00 MB image at 174.36 MB/s
Jul 14 18:09:45 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587 is being set with open permissions: ugo+rw
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:45 devstack sudo[105889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587
Jul 14 18:09:45 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:45 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:46 devstack sudo[105891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:46 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-5d521df8-9db3-4708-a55f-7fffca18783e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-5d521df8-9db3-4708-a55f-7fffca18783e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-quobyte-5d521df8-9db3-4708-a55f-7fffca18783e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-5d521df8-9db3-4708-a55f-7fffca18783e" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:46 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587" returned: 0 in 0.314s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Lock "cinder-quobyte-5582d503-f7ac-4595-8a29-687441bca587" released by "_copy_volume_from_snapshot" :: held 7.648s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8faf914-7f23-482e-b2ca-ee1ab356ad45]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5d521df8-9db3-4708-a55f-7fffca18783e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Lock "cinder-quobyte-bc2d69e1-326e-435e-9ff7-c6d8e888981f-5582d503-f7ac-4595-8a29-687441bca587" released by "_create_volume_from_snapshot" :: held 7.714s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.750s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.737s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512231208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dcd45c-defb-4827-8ed5-20ef396f23e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab45f362a704b80bca31b165f3ce0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:36Z,use_quota=True,user_id='d59613b6463842ea84242b9e3506c485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Creating volume 35dcd45c-defb-4827-8ed5-20ef396f23e2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:46 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-35dcd45c-defb-4827-8ed5-20ef396f23e2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:46 devstack sudo[105895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-35dcd45c-defb-4827-8ed5-20ef396f23e2 1073741824
Jul 14 18:09:46 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4a3586-6c89-44f1-863a-b63f538ea101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5582d503-f7ac-4595-8a29-687441bca587', 'volume_size': 1, 'snapshot_id': 'bc2d69e1-326e-435e-9ff7-c6d8e888981f'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf4d12e0-0d75-4c5c-b212-880641bb2a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:46 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Volume volume-5582d503-f7ac-4595-8a29-687441bca587 (5582d503-f7ac-4595-8a29-687441bca587): created successfully
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf4d12e0-0d75-4c5c-b212-880641bb2a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Flow 'volume_create_manager' (89c30c8c-67c6-4c53-a21c-c9631c307800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:46 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5d521df8-9db3-4708-a55f-7fffca18783e
Jul 14 18:09:46 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:46 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c18b6d81-eee4-4965-b488-92d9b89d3aed tempest-VolumeDependencyTests-587201018 None] Created volume successfully.
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.448s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Deleted volume successfully.
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-064d1ae1-588d-4664-a517-e32073592396 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-b6c0f128-e8b7-4dc2-8f12-7d62061d34a2-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Acquiring lock "cinder-bc2d69e1-326e-435e-9ff7-c6d8e888981f-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-bc2d69e1-326e-435e-9ff7-c6d8e888981f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Acquiring lock "cinder-quobyte-69709163-a3ee-4797-bd60-e18a3aa827bd" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-quobyte-69709163-a3ee-4797-bd60-e18a3aa827bd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Acquiring lock "cinder-quobyte-bc2d69e1-326e-435e-9ff7-c6d8e888981f" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-quobyte-bc2d69e1-326e-435e-9ff7-c6d8e888981f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Deleting offline snapshot bc2d69e1-326e-435e-9ff7-c6d8e888981f of volume 69709163-a3ee-4797-bd60-e18a3aa827bd {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] snapshot_file for this snap is: volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3e86d4-333c-4a04-a060-63f618ff9fbb]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:46 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5d521df8-9db3-4708-a55f-7fffca18783e" returned: 0 in 0.500s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5d521df8-9db3-4708-a55f-7fffca18783e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:46 devstack sudo[105906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5d521df8-9db3-4708-a55f-7fffca18783e
Jul 14 18:09:46 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:46 devstack sudo[105905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f
Jul 14 18:09:46 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:46 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-35dcd45c-defb-4827-8ed5-20ef396f23e2 1073741824" returned: 0 in 0.644s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-35dcd45c-defb-4827-8ed5-20ef396f23e2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:46 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-35dcd45c-defb-4827-8ed5-20ef396f23e2
Jul 14 18:09:46 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:47 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5d521df8-9db3-4708-a55f-7fffca18783e" returned: 0 in 0.298s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-5d521df8-9db3-4708-a55f-7fffca18783e" released by "delete_volume" :: held 0.866s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created reservations ['f152430f-2b53-472f-8d63-68e2811ed582', '53305e25-a141-41d3-a6d5-07b440a79b79', 'b0018ad0-8b84-45ec-99d9-038ec3848da3', 'e23170d5-2cc2-4d32-986e-a672563a129b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:47 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f" returned: 0 in 0.423s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69709163-a3ee-4797-bd60-e18a3aa827bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d253b90b-be14-4a5f-891a-a1a8d0404269]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:47 devstack sudo[105918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:47 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:47 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-35dcd45c-defb-4827-8ed5-20ef396f23e2" returned: 0 in 0.335s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:47 devstack sudo[105916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2a75c8-6fb7-4ea1-8688-9f7872b99eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35dcd45c-defb-4827-8ed5-20ef396f23e2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:47 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c67b0ed-306d-4dd6-9ba7-eed2c58e4eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-8ea584e9-461a-4ef3-9734-4d7d0868960f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:47 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Volume volume-35dcd45c-defb-4827-8ed5-20ef396f23e2 (35dcd45c-defb-4827-8ed5-20ef396f23e2): created successfully
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c67b0ed-306d-4dd6-9ba7-eed2c58e4eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Flow 'volume_create_manager' (6c41d45f-8e76-4833-91ae-a3ca9640a86c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-8ea584e9-461a-4ef3-9734-4d7d0868960f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-112c9efc-225e-4fd7-82fa-f14ac1f83d54 tempest-ProjectReaderTests-560304223 None] Created volume successfully.
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-quobyte-8ea584e9-461a-4ef3-9734-4d7d0868960f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-8ea584e9-461a-4ef3-9734-4d7d0868960f" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a890d7f2-d2f2-42b8-bfac-8a80e58a5bdb]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8ea584e9-461a-4ef3-9734-4d7d0868960f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:47 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.365s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:47 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Deleted volume successfully.
Jul 14 18:09:47 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-08141eab-27b7-4718-9de8-2b6c25d1362e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-5d521df8-9db3-4708-a55f-7fffca18783e-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:47 devstack sudo[105921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8ea584e9-461a-4ef3-9734-4d7d0868960f
Jul 14 18:09:47 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd" returned: 0 in 0.513s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:47 devstack sudo[105927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f
Jul 14 18:09:47 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Acquiring lock "cinder-35dcd45c-defb-4827-8ed5-20ef396f23e2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Lock "cinder-35dcd45c-defb-4827-8ed5-20ef396f23e2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Acquiring lock "cinder-quobyte-35dcd45c-defb-4827-8ed5-20ef396f23e2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Lock "cinder-quobyte-35dcd45c-defb-4827-8ed5-20ef396f23e2" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6631fc9-878f-4595-a736-3c0469ec3c2f]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-35dcd45c-defb-4827-8ed5-20ef396f23e2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (508f7a3b-73df-4844-ae37-2d13c9385145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c63459b-f596-411a-a2e8-e8670dbb0289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c63459b-f596-411a-a2e8-e8670dbb0289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467727355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d17d0f8-91a5-4971-ad91-1ae84c29b868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:48Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c754993-7d48-4261-9f06-9c3418be875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c754993-7d48-4261-9f06-9c3418be875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612edb8c-d153-4682-826d-5a00ce5883d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612edb8c-d153-4682-826d-5a00ce5883d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d17d0f8-91a5-4971-ad91-1ae84c29b868', 'volume_name': 'volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a140bca0-c430-4542-a8b8-807b9506f033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:48 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:48 devstack sudo[105929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-35dcd45c-defb-4827-8ed5-20ef396f23e2
Jul 14 18:09:48 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a140bca0-c430-4542-a8b8-807b9506f033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456850a2-732c-4c54-a8a1-3d8c4def30a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:48 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Volume 3d17d0f8-91a5-4971-ad91-1ae84c29b868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868', 'volume_size': 1}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-467727355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d17d0f8-91a5-4971-ad91-1ae84c29b868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:48Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Creating volume 3d17d0f8-91a5-4971-ad91-1ae84c29b868 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:48 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8ea584e9-461a-4ef3-9734-4d7d0868960f" returned: 0 in 0.545s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8ea584e9-461a-4ef3-9734-4d7d0868960f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:48 devstack sudo[105939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868 1073741824
Jul 14 18:09:48 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:48 devstack sudo[105940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8ea584e9-461a-4ef3-9734-4d7d0868960f
Jul 14 18:09:48 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:48 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f" returned: 0 in 0.446s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:48 devstack sudo[105943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f
Jul 14 18:09:48 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:48 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-35dcd45c-defb-4827-8ed5-20ef396f23e2" returned: 0 in 0.411s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-35dcd45c-defb-4827-8ed5-20ef396f23e2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:48 devstack sudo[105952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-35dcd45c-defb-4827-8ed5-20ef396f23e2
Jul 14 18:09:48 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:48 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8ea584e9-461a-4ef3-9734-4d7d0868960f" returned: 0 in 0.286s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-8ea584e9-461a-4ef3-9734-4d7d0868960f" released by "delete_volume" :: held 0.889s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=246,cinder:SELECT=168,cinder:INSERT=67,cinder:DELETE=24 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:09:48 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd.bc2d69e1-326e-435e-9ff7-c6d8e888981f" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-quobyte-bc2d69e1-326e-435e-9ff7-c6d8e888981f" released by "_delete_snapshot" :: held 1.822s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-quobyte-69709163-a3ee-4797-bd60-e18a3aa827bd" released by "delete_snapshot" :: held 1.852s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created reservations ['d7c5f513-f9b8-4664-968d-73a510595b66', '9a43861c-0b8f-435f-9a78-bf4102c2d10c', 'b12c077c-458f-4a78-be2d-0570ae202323', 'bc02ba86-c182-4fa7-9cc2-7d77e8d72e6b'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:48 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868 1073741824" returned: 0 in 0.524s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:48 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-35dcd45c-defb-4827-8ed5-20ef396f23e2" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Created reservations ['c0f60c66-6cc7-43a6-99d6-f90a783efeac', 'd70f4521-eb86-4c23-8bf5-a8ead1e3903b', 'd934aaef-db2b-42eb-b074-6affc75dc538', 'f3887651-fb7c-49d1-8ec7-ee19c8ace3cd'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Lock "cinder-quobyte-35dcd45c-defb-4827-8ed5-20ef396f23e2" released by "delete_volume" :: held 0.772s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:48 devstack sudo[105958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868
Jul 14 18:09:48 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:48 devstack sudo[105960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:48 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Delete snapshot completed successfully.
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Acquiring lock "cinder-69709163-a3ee-4797-bd60-e18a3aa827bd-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-adc9e58c-a51e-4cd5-9b47-3c7fba6cc939 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-bc2d69e1-326e-435e-9ff7-c6d8e888981f-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Created reservations ['51074990-4a43-4830-b006-220af8cf8831', '8b655590-12f7-486d-9bd6-ca81a44f4d7d', '052a3bc3-999d-4fcf-9831-ec9b0115955d', '388ba0c8-505e-40f8-9e3f-030c9952f71e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-69709163-a3ee-4797-bd60-e18a3aa827bd-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:48 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Acquiring lock "cinder-quobyte-69709163-a3ee-4797-bd60-e18a3aa827bd" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-quobyte-69709163-a3ee-4797-bd60-e18a3aa827bd" acquired by "delete_volume" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:49 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[94705e61-954c-4c26-953b-9d567da15d19]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456850a2-732c-4c54-a8a1-3d8c4def30a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14dcca2-0e64-43bd-b000-f5bc92ba5413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:49 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:49 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Volume volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868 (3d17d0f8-91a5-4971-ad91-1ae84c29b868): created successfully
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14dcca2-0e64-43bd-b000-f5bc92ba5413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (508f7a3b-73df-4844-ae37-2d13c9385145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:49 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:49 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.357s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Deleted volume successfully.
Jul 14 18:09:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-50a01965-22bf-4039-a302-3ccfedae370d tempest-ProjectMemberTests-762530236 None] Created volume successfully.
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b3c86f36-a620-492a-9865-cf9a98b5637e tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-8ea584e9-461a-4ef3-9734-4d7d0868960f-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:49 devstack sudo[105964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd
Jul 14 18:09:49 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:49 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.261s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:49 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Deleted volume successfully.
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d03b4725-bab3-47ef-9c0d-2be58462c8b1 tempest-ProjectReaderTests-560304223 None] Lock "cinder-35dcd45c-defb-4827-8ed5-20ef396f23e2-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:49 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd" returned: 0 in 0.400s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:49 devstack sudo[105972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd
Jul 14 18:09:49 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-e39255b7-b2c2-4d66-8504-1bafd3ba3eec-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-e39255b7-b2c2-4d66-8504-1bafd3ba3eec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-quobyte-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-quobyte-e39255b7-b2c2-4d66-8504-1bafd3ba3eec" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-e39255b7-b2c2-4d66-8504-1bafd3ba3eec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Deleting offline snapshot e39255b7-b2c2-4d66-8504-1bafd3ba3eec of volume c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] snapshot_file for this snap is: volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ff983f-1878-4700-801b-cd6db401261d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:49 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-69709163-a3ee-4797-bd60-e18a3aa827bd" returned: 0 in 0.273s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-quobyte-69709163-a3ee-4797-bd60-e18a3aa827bd" released by "delete_volume" :: held 0.743s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Created reservations ['f63cc3ba-4cb0-499f-a1d8-f918e458d153', 'fe74fce9-1df2-430d-983f-693dfb5c45e1', '225320dc-d00a-440d-8105-d3cc3372ef45', '576708ac-c6d2-46b1-9034-baf23994c31c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:49 devstack sudo[105975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec
Jul 14 18:09:49 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:49 devstack sudo[105978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:49 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:50 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec" returned: 0 in 0.410s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:09:50 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[43224931-f937-46ce-8bf9-4b0208fdb48d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Deleted volume successfully.
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-51639b6e-b485-4075-a0d5-ef139ee02fb3 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-69709163-a3ee-4797-bd60-e18a3aa827bd-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:50 devstack sudo[105984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2
Jul 14 18:09:50 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Acquiring lock "cinder-5582d503-f7ac-4595-8a29-687441bca587-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-5582d503-f7ac-4595-8a29-687441bca587-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Acquiring lock "cinder-quobyte-5582d503-f7ac-4595-8a29-687441bca587" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-quobyte-5582d503-f7ac-4595-8a29-687441bca587" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b7367e-c355-4d9e-9140-7470b6052693]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:50 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2" returned: 0 in 0.499s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:50 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587
Jul 14 18:09:50 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:50 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec
Jul 14 18:09:50 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Flow 'volume_create_manager' (175d4c7c-5375-420c-bb1d-e39f23c7662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fe7c5d-8a03-40a2-8b43-d8d5ece668db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fe7c5d-8a03-40a2-8b43-d8d5ece668db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543707181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07368d47-90d2-4764-8a6e-556450d55caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab45f362a704b80bca31b165f3ce0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:51Z,use_quota=True,user_id='d59613b6463842ea84242b9e3506c485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686c0730-0e0f-4bbe-a26c-dace3acdff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686c0730-0e0f-4bbe-a26c-dace3acdff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f083197a-5c38-40cc-84f5-690b0c915c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f083197a-5c38-40cc-84f5-690b0c915c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07368d47-90d2-4764-8a6e-556450d55caf', 'volume_name': 'volume-07368d47-90d2-4764-8a6e-556450d55caf', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d174fb-659b-48a5-bfb7-8395c04e65ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d174fb-659b-48a5-bfb7-8395c04e65ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efdd128-2d93-42e2-a6a7-4d9e7412ec3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:50 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Volume 07368d47-90d2-4764-8a6e-556450d55caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07368d47-90d2-4764-8a6e-556450d55caf', 'volume_size': 1}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] Creating offline snapshot f9d1be61-7510-45e4-8193-44f5910d638e of volume 3d17d0f8-91a5-4971-ad91-1ae84c29b868 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[b517650e-70db-4305-866f-52fd2dd2596d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:50 devstack sudo[105993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868
Jul 14 18:09:50 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:50 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587" returned: 0 in 0.415s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:51 devstack sudo[106002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587
Jul 14 18:09:51 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:51 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec" returned: 0 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:51 devstack sudo[106004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec
Jul 14 18:09:51 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:51 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868" returned: 0 in 0.391s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:51 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e 1G
Jul 14 18:09:51 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:51 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-5582d503-f7ac-4595-8a29-687441bca587" returned: 0 in 0.297s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-quobyte-5582d503-f7ac-4595-8a29-687441bca587" released by "delete_volume" :: held 0.753s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:51 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2.e39255b7-b2c2-4d66-8504-1bafd3ba3eec" returned: 0 in 0.264s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-e39255b7-b2c2-4d66-8504-1bafd3ba3eec" released by "_delete_snapshot" :: held 1.668s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2" released by "delete_snapshot" :: held 1.695s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Created reservations ['e92b5e8a-1165-4d8e-a731-fab194f8818a', 'd9a894dc-6e5f-4736-b3c1-43a38dcbd91c', '953b47b0-d0a0-4b04-9a0c-71168ddf7028', '26e67f11-6026-4c90-959b-48c05fbe647c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created reservations ['795ff65b-b7e5-478f-a0c9-2c783a0604cf', '31f0d2d9-2b36-4b21-bfaf-adf7ce9e774a', '7de12ec9-9620-4dfb-8eef-8c3eee310108', '4b95bfd4-4a8b-4b32-9ca9-142791beadb2'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:51 devstack sudo[106015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:51 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Delete snapshot completed successfully.
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f7cd3da3-b3e4-4f01-a022-735d53d93aa4 tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-e39255b7-b2c2-4d66-8504-1bafd3ba3eec-delete_snapshot" released by "delete_snapshot" :: held 1.894s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:51 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e 1G" returned: 0 in 0.496s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:51 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e
Jul 14 18:09:51 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:51 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.344s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:51 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Deleted volume successfully.
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dc353574-0c3a-43a5-bd40-dbfe3353d817 tempest-VolumeDependencyTests-587201018 None] Lock "cinder-5582d503-f7ac-4595-8a29-687441bca587-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "cinder-quobyte-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1548408-e322-4a1c-98ce-f191e3a4d8b6]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:52 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2
Jul 14 18:09:52 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:52 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e" returned: 0 in 0.424s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:52 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e is being set with open permissions: ugo+rw
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:52 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e
Jul 14 18:09:52 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:52 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2" returned: 0 in 0.425s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:52 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e" returned: 0 in 0.273s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:52 devstack sudo[106033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2
Jul 14 18:09:52 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:52 devstack sudo[106035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.info
Jul 14 18:09:52 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:52 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2" returned: 0 in 0.361s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:52 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.info" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:52 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.info is being set with open permissions: ugo+rw
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-quobyte-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2" released by "delete_volume" :: held 0.882s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:52 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.info
Jul 14 18:09:52 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Created reservations ['9d526e4e-4a15-4b5e-923d-c3b596b44caf', 'a357ec38-b971-4854-b6b8-ccb22878518a', 'b3d174a5-7f50-4393-b2a8-d50d4ccf12ef', '28c0ed78-a5ac-4bf3-99b5-cb0dff20477c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:52 devstack sudo[106041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:52 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:53 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.info" returned: 0 in 0.287s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.292s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543707181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07368d47-90d2-4764-8a6e-556450d55caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab45f362a704b80bca31b165f3ce0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:51Z,use_quota=True,user_id='d59613b6463842ea84242b9e3506c485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Creating volume 07368d47-90d2-4764-8a6e-556450d55caf {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:53 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-07368d47-90d2-4764-8a6e-556450d55caf 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:53 devstack sudo[106044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-07368d47-90d2-4764-8a6e-556450d55caf 1073741824
Jul 14 18:09:53 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fd27acdf-2c9d-4497-9471-717c3c7b6df0 tempest-ProjectMemberTests-762530236 None] Create snapshot completed successfully
Jul 14 18:09:53 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.352s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Deleted volume successfully.
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-eea2d5c7-69ab-4b0e-b027-52a4a52a9f0b tempest-CreateVolumesFromSnapshotTest-1503989656 None] Lock "cinder-c9a4e8ab-5052-41b3-ae7a-c5540eef58d2-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:53 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-07368d47-90d2-4764-8a6e-556450d55caf 1073741824" returned: 0 in 0.575s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-07368d47-90d2-4764-8a6e-556450d55caf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-f9d1be61-7510-45e4-8193-44f5910d638e-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:53 devstack sudo[106050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-07368d47-90d2-4764-8a6e-556450d55caf
Jul 14 18:09:53 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Lock "cinder-f9d1be61-7510-45e4-8193-44f5910d638e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-3d17d0f8-91a5-4971-ad91-1ae84c29b868" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-3d17d0f8-91a5-4971-ad91-1ae84c29b868" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-f9d1be61-7510-45e4-8193-44f5910d638e" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-f9d1be61-7510-45e4-8193-44f5910d638e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Deleting offline snapshot f9d1be61-7510-45e4-8193-44f5910d638e of volume 3d17d0f8-91a5-4971-ad91-1ae84c29b868 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] snapshot_file for this snap is: volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[144724d9-03ba-4f0c-bd45-d64bbdcd7bed]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:54 devstack sudo[106052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e
Jul 14 18:09:54 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:54 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-07368d47-90d2-4764-8a6e-556450d55caf" returned: 0 in 0.414s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=241,cinder:UPDATE=301,cinder:DELETE=27,cinder:INSERT=79 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efdd128-2d93-42e2-a6a7-4d9e7412ec3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07368d47-90d2-4764-8a6e-556450d55caf', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1f18b8-adcf-4220-9ac0-b00ff766aa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:54 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Volume volume-07368d47-90d2-4764-8a6e-556450d55caf (07368d47-90d2-4764-8a6e-556450d55caf): created successfully
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1f18b8-adcf-4220-9ac0-b00ff766aa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Flow 'volume_create_manager' (175d4c7c-5375-420c-bb1d-e39f23c7662b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:54 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2dac75a1-84bd-4888-915d-0aca964fb117 tempest-ProjectReaderTests-560304223 None] Created volume successfully.
Jul 14 18:09:54 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e" returned: 0 in 0.472s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[afede3fb-dfeb-47c4-b5fa-80ee3b262a2b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:54 devstack sudo[106058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868
Jul 14 18:09:54 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:54 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868" returned: 0 in 0.457s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:54 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e
Jul 14 18:09:54 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Acquiring lock "cinder-07368d47-90d2-4764-8a6e-556450d55caf-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Lock "cinder-07368d47-90d2-4764-8a6e-556450d55caf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Acquiring lock "cinder-quobyte-07368d47-90d2-4764-8a6e-556450d55caf" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Lock "cinder-quobyte-07368d47-90d2-4764-8a6e-556450d55caf" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[190f3b6c-b42f-4d57-bd3e-68be70496626]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-07368d47-90d2-4764-8a6e-556450d55caf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:55 devstack sudo[106073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-07368d47-90d2-4764-8a6e-556450d55caf
Jul 14 18:09:55 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:55 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e" returned: 0 in 0.514s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:55 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e
Jul 14 18:09:55 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:55 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-07368d47-90d2-4764-8a6e-556450d55caf" returned: 0 in 0.421s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-07368d47-90d2-4764-8a6e-556450d55caf {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:55 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-07368d47-90d2-4764-8a6e-556450d55caf
Jul 14 18:09:55 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:55 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868.f9d1be61-7510-45e4-8193-44f5910d638e" returned: 0 in 0.304s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-f9d1be61-7510-45e4-8193-44f5910d638e" released by "_delete_snapshot" :: held 1.903s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-3d17d0f8-91a5-4971-ad91-1ae84c29b868" released by "delete_snapshot" :: held 1.934s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Created reservations ['7a79846b-610a-4908-a5a4-2c3f2478b80d', 'e8c0721a-e4e1-426a-8a93-0073086842c2', 'bf21c5b2-6d58-4ab9-80e5-ca9ea6698a1a', 'df997a10-36b7-4dee-9bad-3151e4ec31e4'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-b22bb14d-e986-4e23-ad69-a0e023e3c519 tempest-ProjectAdminTests-99945290 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87401) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 14 18:09:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Delete snapshot completed successfully.
Jul 14 18:09:55 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3f6d3df7-a8ee-418a-8dc8-6acd2a45d5f3 tempest-ProjectMemberTests-762530236 None] Lock "cinder-f9d1be61-7510-45e4-8193-44f5910d638e-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:55 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-07368d47-90d2-4764-8a6e-556450d55caf" returned: 0 in 0.344s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-3d17d0f8-91a5-4971-ad91-1ae84c29b868-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Lock "cinder-quobyte-07368d47-90d2-4764-8a6e-556450d55caf" released by "delete_volume" :: held 0.844s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Lock "cinder-3d17d0f8-91a5-4971-ad91-1ae84c29b868-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-3d17d0f8-91a5-4971-ad91-1ae84c29b868" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-3d17d0f8-91a5-4971-ad91-1ae84c29b868" acquired by "delete_volume" :: waited 0.024s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Created reservations ['20850aa4-e88a-4509-abc4-cc547c7357c4', '53c0645f-c1ec-4940-86bb-3158988bbdf1', '33189cca-cf30-44e6-a44d-85e7e956e10d', '7017551d-be78-4620-87a9-79ede5375fea'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f508fc-fc50-46e2-b333-5f0f89fd817a]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:56 devstack sudo[106087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:56 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:56 devstack sudo[106086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868
Jul 14 18:09:56 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:56 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.277s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:56 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Deleted volume successfully.
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-12f08ccb-7196-43b1-8727-522620ff2451 tempest-ProjectReaderTests-560304223 None] Lock "cinder-07368d47-90d2-4764-8a6e-556450d55caf-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:56 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868" returned: 0 in 0.517s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:56 devstack sudo[106094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868
Jul 14 18:09:56 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:56 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3d17d0f8-91a5-4971-ad91-1ae84c29b868" returned: 0 in 0.256s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-3d17d0f8-91a5-4971-ad91-1ae84c29b868" released by "delete_volume" :: held 0.861s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:57 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Created reservations ['48454628-3afb-4b4e-87f0-0ec4197e3afe', 'a644bc6e-5816-4a2f-b124-dbf8dbb06039', '2bbf77d9-71da-43d0-bc6f-90cf734ee115', '44cc0cbb-7bef-4a15-afdd-f0ee81cd7fbb'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:09:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:57 devstack sudo[106097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:09:57 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:57 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:57 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:09:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Deleted volume successfully.
Jul 14 18:09:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-8dc22428-902b-439e-bf73-1e6221d3ba6f tempest-ProjectMemberTests-762530236 None] Lock "cinder-3d17d0f8-91a5-4971-ad91-1ae84c29b868-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (aff1b9e9-d937-49a7-a6a2-269552c82933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4027f8e7-248e-4a3f-a0a4-5372300b54cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4027f8e7-248e-4a3f-a0a4-5372300b54cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1752217704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2988f221-24cf-4ce8-a63e-5aa808129ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:58Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3de422-c24a-40e1-9142-66b3a51e8cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3de422-c24a-40e1-9142-66b3a51e8cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e524b87-48ba-4534-9efd-9d60a55e5d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e524b87-48ba-4534-9efd-9d60a55e5d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2988f221-24cf-4ce8-a63e-5aa808129ac0', 'volume_name': 'volume-2988f221-24cf-4ce8-a63e-5aa808129ac0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6bbf56-8745-4945-b50f-c9e2b53095a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6bbf56-8745-4945-b50f-c9e2b53095a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f5f568-acdb-41f3-807e-f3300d87bfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Volume 2988f221-24cf-4ce8-a63e-5aa808129ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2988f221-24cf-4ce8-a63e-5aa808129ac0', 'volume_size': 1}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1752217704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2988f221-24cf-4ce8-a63e-5aa808129ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:58Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Creating volume 2988f221-24cf-4ce8-a63e-5aa808129ac0 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:58 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:58 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0 1073741824
Jul 14 18:09:58 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Flow 'volume_create_manager' (bcf9ddf8-b20b-4024-89fe-c477fc846fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2d482f-0363-4658-99ec-a063bf8cded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2d482f-0363-4658-99ec-a063bf8cded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-111031621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7860f61-696b-4f64-b9c1-d4633ff950ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab45f362a704b80bca31b165f3ce0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:58Z,use_quota=True,user_id='d59613b6463842ea84242b9e3506c485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b796ac7c-f55e-4df6-9601-19fb1bc53cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b796ac7c-f55e-4df6-9601-19fb1bc53cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d98bba0-7b89-49b9-993f-cf433cec94dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d98bba0-7b89-49b9-993f-cf433cec94dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7860f61-696b-4f64-b9c1-d4633ff950ce', 'volume_name': 'volume-a7860f61-696b-4f64-b9c1-d4633ff950ce', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38764ecd-a9c7-422b-8a2f-355c7e0e3dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38764ecd-a9c7-422b-8a2f-355c7e0e3dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf790a5-66ea-45a4-9a84-6f6d700be1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:58 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Volume a7860f61-696b-4f64-b9c1-d4633ff950ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7860f61-696b-4f64-b9c1-d4633ff950ce', 'volume_size': 1}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:58 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0 1073741824" returned: 0 in 0.540s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:59 devstack sudo[106106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0
Jul 14 18:09:59 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:59 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0" returned: 0 in 0.270s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.655s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-111031621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7860f61-696b-4f64-b9c1-d4633ff950ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab45f362a704b80bca31b165f3ce0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:09:58Z,use_quota=True,user_id='d59613b6463842ea84242b9e3506c485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Creating volume a7860f61-696b-4f64-b9c1-d4633ff950ce {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:09:59 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a7860f61-696b-4f64-b9c1-d4633ff950ce 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f5f568-acdb-41f3-807e-f3300d87bfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2988f221-24cf-4ce8-a63e-5aa808129ac0', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:59 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a7860f61-696b-4f64-b9c1-d4633ff950ce 1073741824
Jul 14 18:09:59 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4145d94f-d06b-451c-b3a6-f7e5df8a427c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:09:59 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Volume volume-2988f221-24cf-4ce8-a63e-5aa808129ac0 (2988f221-24cf-4ce8-a63e-5aa808129ac0): created successfully
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4145d94f-d06b-451c-b3a6-f7e5df8a427c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (aff1b9e9-d937-49a7-a6a2-269552c82933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:09:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c69c0645-f965-40f2-8446-104f018eef2a tempest-ProjectMemberTests-762530236 None] Created volume successfully.
Jul 14 18:09:59 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a7860f61-696b-4f64-b9c1-d4633ff950ce 1073741824" returned: 0 in 0.471s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:09:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a7860f61-696b-4f64-b9c1-d4633ff950ce {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:09:59 devstack sudo[106115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a7860f61-696b-4f64-b9c1-d4633ff950ce
Jul 14 18:09:59 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:00 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a7860f61-696b-4f64-b9c1-d4633ff950ce" returned: 0 in 0.289s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf790a5-66ea-45a4-9a84-6f6d700be1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7860f61-696b-4f64-b9c1-d4633ff950ce', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbd98a2-e4b4-4647-a4b6-a56abf0e5349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Volume volume-a7860f61-696b-4f64-b9c1-d4633ff950ce (a7860f61-696b-4f64-b9c1-d4633ff950ce): created successfully
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbd98a2-e4b4-4647-a4b6-a56abf0e5349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Flow 'volume_create_manager' (bcf9ddf8-b20b-4024-89fe-c477fc846fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:00 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-584ac423-0886-4627-9494-33e7795e855d tempest-ProjectReaderTests-560304223 None] Created volume successfully.
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] Creating offline snapshot face8cb9-cd6b-4733-b0be-6678065feb94 of volume 2988f221-24cf-4ce8-a63e-5aa808129ac0 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c8f6d5-36e9-411a-869b-c5756c234a5a]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Acquiring lock "cinder-a7860f61-696b-4f64-b9c1-d4633ff950ce-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Lock "cinder-a7860f61-696b-4f64-b9c1-d4633ff950ce-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:00 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0
Jul 14 18:10:00 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Acquiring lock "cinder-quobyte-a7860f61-696b-4f64-b9c1-d4633ff950ce" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Lock "cinder-quobyte-a7860f61-696b-4f64-b9c1-d4633ff950ce" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d196d6a1-3f2d-4168-a8d1-eb363d4590dc]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a7860f61-696b-4f64-b9c1-d4633ff950ce {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:00 devstack sudo[106122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a7860f61-696b-4f64-b9c1-d4633ff950ce
Jul 14 18:10:00 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:00 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0" returned: 0 in 0.391s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:00 devstack sudo[106127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94 1G
Jul 14 18:10:00 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:01 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a7860f61-696b-4f64-b9c1-d4633ff950ce" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a7860f61-696b-4f64-b9c1-d4633ff950ce {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:01 devstack sudo[106132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a7860f61-696b-4f64-b9c1-d4633ff950ce
Jul 14 18:10:01 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:01 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:01 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-a7860f61-696b-4f64-b9c1-d4633ff950ce" returned: 0 in 0.347s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94 1G" returned: 0 in 0.535s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2988f221-24cf-4ce8-a63e-5aa808129ac0 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Lock "cinder-quobyte-a7860f61-696b-4f64-b9c1-d4633ff950ce" released by "delete_volume" :: held 0.791s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:01 devstack sudo[106139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2988f221-24cf-4ce8-a63e-5aa808129ac0 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94
Jul 14 18:10:01 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Created reservations ['9ba23882-7d58-4a44-9e2b-678fd17aa049', 'b8d5bffb-1ce8-4dce-a7ce-3e50224fb1b4', '7e6d0688-d6e4-490a-ac62-5241bee50fbf', '5291a15c-7339-402d-81ed-d7844ab57260'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:01 devstack sudo[106141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:10:01 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:01 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2988f221-24cf-4ce8-a63e-5aa808129ac0 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94" returned: 0 in 0.391s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:01 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94 is being set with open permissions: ugo+rw
Jul 14 18:10:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:01 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94
Jul 14 18:10:01 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:01 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.361s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:02 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:10:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Deleted volume successfully.
Jul 14 18:10:02 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3487a386-cdc9-42a0-81f2-bc13f3b642f8 tempest-ProjectReaderTests-560304223 None] Lock "cinder-a7860f61-696b-4f64-b9c1-d4633ff950ce-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:02 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94" returned: 0 in 0.391s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:02 devstack sudo[106150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.info
Jul 14 18:10:02 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:02 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.info" returned: 0 in 0.303s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:02 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.info is being set with open permissions: ugo+rw
Jul 14 18:10:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:02 devstack sudo[106153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.info
Jul 14 18:10:02 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:02 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.info" returned: 0 in 0.258s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:02 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-463ffb1f-889b-422c-907f-9b2a8d1826cd tempest-ProjectMemberTests-762530236 None] Create snapshot completed successfully
Jul 14 18:10:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-face8cb9-cd6b-4733-b0be-6678065feb94-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Lock "cinder-face8cb9-cd6b-4733-b0be-6678065feb94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-2988f221-24cf-4ce8-a63e-5aa808129ac0" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-2988f221-24cf-4ce8-a63e-5aa808129ac0" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-face8cb9-cd6b-4733-b0be-6678065feb94" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:03 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-face8cb9-cd6b-4733-b0be-6678065feb94" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Deleting offline snapshot face8cb9-cd6b-4733-b0be-6678065feb94 of volume 2988f221-24cf-4ce8-a63e-5aa808129ac0 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:10:03 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] snapshot_file for this snap is: volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:10:03 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f8ca0b-a752-401d-8d41-9d0cebbb06c0]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:03 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94
Jul 14 18:10:03 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:04 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94" returned: 0 in 0.481s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2988f221-24cf-4ce8-a63e-5aa808129ac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:10:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[559d57c2-28fc-4663-9795-8da700329802]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:04 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0
Jul 14 18:10:04 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:04 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0" returned: 0 in 0.405s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:04 devstack sudo[106166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94
Jul 14 18:10:04 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:05 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94" returned: 0 in 0.335s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:05 devstack sudo[106171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94
Jul 14 18:10:05 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:05 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0.face8cb9-cd6b-4733-b0be-6678065feb94" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-face8cb9-cd6b-4733-b0be-6678065feb94" released by "_delete_snapshot" :: held 1.674s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-2988f221-24cf-4ce8-a63e-5aa808129ac0" released by "delete_snapshot" :: held 1.707s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:05 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Created reservations ['f31f9c97-35f0-44bf-b9e8-a1638fd5210b', '9c4eff00-8cf2-479f-b504-76ad4c83a27c', 'dafa73a8-3d83-4d4f-9204-cc704dfc1645', '9e5d09cd-eac5-46c5-8a19-2b4c103c8cd6'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Delete snapshot completed successfully.
Jul 14 18:10:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-09cfa287-12b9-4577-a477-50e8ab872985 tempest-ProjectMemberTests-762530236 None] Lock "cinder-face8cb9-cd6b-4733-b0be-6678065feb94-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-2988f221-24cf-4ce8-a63e-5aa808129ac0-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Lock "cinder-2988f221-24cf-4ce8-a63e-5aa808129ac0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:05 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-2988f221-24cf-4ce8-a63e-5aa808129ac0" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-2988f221-24cf-4ce8-a63e-5aa808129ac0" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[362807dc-f5db-495e-8978-eb7e20fc9af8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:06 devstack sudo[106174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0
Jul 14 18:10:06 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:06 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0" returned: 0 in 0.404s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:06 devstack sudo[106179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0
Jul 14 18:10:06 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:06 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2988f221-24cf-4ce8-a63e-5aa808129ac0" returned: 0 in 0.285s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-2988f221-24cf-4ce8-a63e-5aa808129ac0" released by "delete_volume" :: held 0.760s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Created reservations ['c0596c47-1d6d-453a-ac09-253992fdd80d', '7254db04-b2a5-40da-bf75-250a9126c76b', '2d2bf629-86fa-4346-88e9-8d8e75252116', '8e6b5f04-a56b-4189-8cc6-19b0edbbd4f0'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:06 devstack sudo[106182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:10:06 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:07 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.332s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:10:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Deleted volume successfully.
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-48f82e6d-7e58-4f91-9b65-4fc137098fa7 tempest-ProjectMemberTests-762530236 None] Lock "cinder-2988f221-24cf-4ce8-a63e-5aa808129ac0-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (af17e4f5-df3a-486d-9746-3b17c8166883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e0d824-9e1e-4fe4-9b05-87ac95c83dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e0d824-9e1e-4fe4-9b05-87ac95c83dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-174988573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47db8ae9-332b-41f1-90fc-31c0053ab93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:08Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6234cb25-9433-4ecd-b504-6b2b23364efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6234cb25-9433-4ecd-b504-6b2b23364efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d37aae-4cbb-4b00-b2b4-ffdb524090fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d37aae-4cbb-4b00-b2b4-ffdb524090fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47db8ae9-332b-41f1-90fc-31c0053ab93b', 'volume_name': 'volume-47db8ae9-332b-41f1-90fc-31c0053ab93b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3372c363-344d-43b6-813a-69b17736fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3372c363-344d-43b6-813a-69b17736fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b93427-0092-4338-912a-21a976234892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:07 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Volume 47db8ae9-332b-41f1-90fc-31c0053ab93b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47db8ae9-332b-41f1-90fc-31c0053ab93b', 'volume_size': 1}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-174988573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47db8ae9-332b-41f1-90fc-31c0053ab93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:08Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Creating volume 47db8ae9-332b-41f1-90fc-31c0053ab93b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:10:07 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:10:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:07 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b 1073741824
Jul 14 18:10:07 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Flow 'volume_create_manager' (c9259ba3-bcde-4901-89bb-05974d3e64e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d5c3a9-76d2-498d-ba83-1ae89815b1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d5c3a9-76d2-498d-ba83-1ae89815b1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316660221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14e7478-747c-41ab-a8cb-e2f698d2fa67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e056312c1bfb4de4b2ad2cb85453a849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:08Z,use_quota=True,user_id='88a6e3e315924f21bfea4518f55a66e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b05858-d631-411a-adf2-cbbffe53f012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b05858-d631-411a-adf2-cbbffe53f012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78699ad2-82e6-4eba-bdb0-3917182234b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78699ad2-82e6-4eba-bdb0-3917182234b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b14e7478-747c-41ab-a8cb-e2f698d2fa67', 'volume_name': 'volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6dc011-d95a-4910-a9ab-4cac609d1c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6dc011-d95a-4910-a9ab-4cac609d1c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529c1bbd-6136-4033-8d37-7a937e09f095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:08 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Volume b14e7478-747c-41ab-a8cb-e2f698d2fa67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67', 'volume_size': 1}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:08 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b 1073741824" returned: 0 in 0.488s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:08 devstack sudo[106191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b
Jul 14 18:10:08 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:08 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b" returned: 0 in 0.288s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316660221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14e7478-747c-41ab-a8cb-e2f698d2fa67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e056312c1bfb4de4b2ad2cb85453a849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:08Z,use_quota=True,user_id='88a6e3e315924f21bfea4518f55a66e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Creating volume b14e7478-747c-41ab-a8cb-e2f698d2fa67 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:10:08 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:08 devstack sudo[106194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67 1073741824
Jul 14 18:10:08 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b93427-0092-4338-912a-21a976234892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47db8ae9-332b-41f1-90fc-31c0053ab93b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58983b1d-0ade-4dfc-8dfa-50696b775cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:08 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Volume volume-47db8ae9-332b-41f1-90fc-31c0053ab93b (47db8ae9-332b-41f1-90fc-31c0053ab93b): created successfully
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58983b1d-0ade-4dfc-8dfa-50696b775cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:08 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (af17e4f5-df3a-486d-9746-3b17c8166883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:08 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-32b29f6c-4d41-42c0-850f-23221d99f85a tempest-ProjectMemberTests-762530236 None] Created volume successfully.
Jul 14 18:10:09 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67 1073741824" returned: 0 in 0.461s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:09 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67
Jul 14 18:10:09 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:09 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67" returned: 0 in 0.246s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529c1bbd-6136-4033-8d37-7a937e09f095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8d3a9a-1e92-4fc5-ae3c-a2236f51e2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:09 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Volume volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67 (b14e7478-747c-41ab-a8cb-e2f698d2fa67): created successfully
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8d3a9a-1e92-4fc5-ae3c-a2236f51e2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Flow 'volume_create_manager' (c9259ba3-bcde-4901-89bb-05974d3e64e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-1560ed7c-de96-44f1-a3cb-75780a849269 tempest-ProjectReaderTests-97541833 None] Created volume successfully.
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] Creating offline snapshot 337f45f0-f1cd-4ba4-857e-ae30b487ebfd of volume 47db8ae9-332b-41f1-90fc-31c0053ab93b {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12ce5a3-0644-4f0a-b1eb-64cff63a61a6]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:10 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b
Jul 14 18:10:10 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Acquiring lock "cinder-b14e7478-747c-41ab-a8cb-e2f698d2fa67-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Lock "cinder-b14e7478-747c-41ab-a8cb-e2f698d2fa67-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:10 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b" returned: 0 in 0.377s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:10 devstack sudo[106210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd 1G
Jul 14 18:10:10 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Acquiring lock "cinder-quobyte-b14e7478-747c-41ab-a8cb-e2f698d2fa67" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Lock "cinder-quobyte-b14e7478-747c-41ab-a8cb-e2f698d2fa67" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a13d5ce-fefc-475a-94c2-dd5563795d92]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:10 devstack sudo[106212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67
Jul 14 18:10:10 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:10 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd 1G" returned: 0 in 0.406s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47db8ae9-332b-41f1-90fc-31c0053ab93b -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:10 devstack sudo[106219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47db8ae9-332b-41f1-90fc-31c0053ab93b -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd
Jul 14 18:10:10 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:10 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67" returned: 0 in 0.404s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:10 devstack sudo[106222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67
Jul 14 18:10:10 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:11 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47db8ae9-332b-41f1-90fc-31c0053ab93b -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd" returned: 0 in 0.305s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:11 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd is being set with open permissions: ugo+rw
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:11 devstack sudo[106228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd
Jul 14 18:10:11 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:11 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b14e7478-747c-41ab-a8cb-e2f698d2fa67" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Lock "cinder-quobyte-b14e7478-747c-41ab-a8cb-e2f698d2fa67" released by "delete_volume" :: held 0.753s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Created reservations ['da29c7d7-abd6-404c-8d10-11c1505296d1', '889d9578-8d4b-4502-b916-0452a7f29fde', '11a5bd62-e0ec-460f-826e-2475be1ee0f4', '78f126df-5656-4ba6-8df6-62e4c7a61266'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:11 devstack sudo[106232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:10:11 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:11 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd" returned: 0 in 0.284s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:11 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.info
Jul 14 18:10:11 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:11 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.275s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:10:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Deleted volume successfully.
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-869f80e9-701a-49b0-ae63-0f9e4d8d9bd2 tempest-ProjectReaderTests-97541833 None] Lock "cinder-b14e7478-747c-41ab-a8cb-e2f698d2fa67-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:11 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.info" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:11 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.info is being set with open permissions: ugo+rw
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:11 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.info
Jul 14 18:10:11 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:11 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.info" returned: 0 in 0.307s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fa76c2c9-a624-4e92-ad37-5b665f00ad33 tempest-ProjectMemberTests-762530236 None] Create snapshot completed successfully
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Flow 'volume_create_manager' (f9a4f659-b1d9-4488-9dd9-e79fb9da59ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4180af1b-3aee-460a-9cd3-a775d740a2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4180af1b-3aee-460a-9cd3-a775d740a2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261119190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673197ba-ee5c-430b-8948-62afa483507e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e056312c1bfb4de4b2ad2cb85453a849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:12Z,use_quota=True,user_id='88a6e3e315924f21bfea4518f55a66e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9bfb458-6781-44a7-a18f-fc7360fcbc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9bfb458-6781-44a7-a18f-fc7360fcbc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2648470a-5f13-499b-8276-86a16568b73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2648470a-5f13-499b-8276-86a16568b73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673197ba-ee5c-430b-8948-62afa483507e', 'volume_name': 'volume-673197ba-ee5c-430b-8948-62afa483507e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b577ec4-e426-4517-ab0b-83dce69e59a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b577ec4-e426-4517-ab0b-83dce69e59a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5afbe0-9d5e-44b2-9456-b879de4d500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:12 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Volume 673197ba-ee5c-430b-8948-62afa483507e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673197ba-ee5c-430b-8948-62afa483507e', 'volume_size': 1}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261119190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673197ba-ee5c-430b-8948-62afa483507e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e056312c1bfb4de4b2ad2cb85453a849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:12Z,use_quota=True,user_id='88a6e3e315924f21bfea4518f55a66e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Creating volume 673197ba-ee5c-430b-8948-62afa483507e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:10:12 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-673197ba-ee5c-430b-8948-62afa483507e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:12 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-673197ba-ee5c-430b-8948-62afa483507e 1073741824
Jul 14 18:10:12 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:12 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-673197ba-ee5c-430b-8948-62afa483507e 1073741824" returned: 0 in 0.419s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-673197ba-ee5c-430b-8948-62afa483507e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:12 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-673197ba-ee5c-430b-8948-62afa483507e
Jul 14 18:10:12 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:12 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-673197ba-ee5c-430b-8948-62afa483507e" returned: 0 in 0.269s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5afbe0-9d5e-44b2-9456-b879de4d500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673197ba-ee5c-430b-8948-62afa483507e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52f4fb9-eb51-4501-a617-76570c502a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:12 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Volume volume-673197ba-ee5c-430b-8948-62afa483507e (673197ba-ee5c-430b-8948-62afa483507e): created successfully
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52f4fb9-eb51-4501-a617-76570c502a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Flow 'volume_create_manager' (f9a4f659-b1d9-4488-9dd9-e79fb9da59ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-04237d62-4f1d-4a2a-91fa-a3ef71c031dc tempest-ProjectReaderTests-97541833 None] Created volume successfully.
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-337f45f0-f1cd-4ba4-857e-ae30b487ebfd-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Lock "cinder-337f45f0-f1cd-4ba4-857e-ae30b487ebfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-47db8ae9-332b-41f1-90fc-31c0053ab93b" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-47db8ae9-332b-41f1-90fc-31c0053ab93b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-337f45f0-f1cd-4ba4-857e-ae30b487ebfd" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-337f45f0-f1cd-4ba4-857e-ae30b487ebfd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Deleting offline snapshot 337f45f0-f1cd-4ba4-857e-ae30b487ebfd of volume 47db8ae9-332b-41f1-90fc-31c0053ab93b {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] snapshot_file for this snap is: volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f3a8b3-852d-4c34-b23b-5c6c4a3c4d68]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:13 devstack sudo[106249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd
Jul 14 18:10:13 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:13 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd" returned: 0 in 0.395s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47db8ae9-332b-41f1-90fc-31c0053ab93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[69277893-96b8-4c16-a399-6b96af9cb396]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:13 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b
Jul 14 18:10:13 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:14 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b" returned: 0 in 0.456s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:14 devstack sudo[106262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd
Jul 14 18:10:14 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Acquiring lock "cinder-673197ba-ee5c-430b-8948-62afa483507e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Lock "cinder-673197ba-ee5c-430b-8948-62afa483507e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Acquiring lock "cinder-quobyte-673197ba-ee5c-430b-8948-62afa483507e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Lock "cinder-quobyte-673197ba-ee5c-430b-8948-62afa483507e" acquired by "delete_volume" :: waited 0.025s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b9bd36-de6a-445b-b007-0669b4d7eb74]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-673197ba-ee5c-430b-8948-62afa483507e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:14 devstack sudo[106264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-673197ba-ee5c-430b-8948-62afa483507e
Jul 14 18:10:14 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:14 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd" returned: 0 in 0.446s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:14 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd
Jul 14 18:10:14 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:14 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-673197ba-ee5c-430b-8948-62afa483507e" returned: 0 in 0.410s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-673197ba-ee5c-430b-8948-62afa483507e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:14 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-673197ba-ee5c-430b-8948-62afa483507e
Jul 14 18:10:14 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:14 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b.337f45f0-f1cd-4ba4-857e-ae30b487ebfd" returned: 0 in 0.289s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-337f45f0-f1cd-4ba4-857e-ae30b487ebfd" released by "_delete_snapshot" :: held 1.706s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-47db8ae9-332b-41f1-90fc-31c0053ab93b" released by "delete_snapshot" :: held 1.731s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:14 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Created reservations ['627e781e-777b-4f71-9dc1-647589bb7551', '0153c921-9bc1-4fcb-9beb-812dab52e623', '771f937a-61d1-4ffe-adfe-a61964e2fefd', '36a0124f-67e2-4586-a6ab-f4c643ba55a8'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Delete snapshot completed successfully.
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-dacf414b-7c42-4abf-8d47-ce7a9a897c47 tempest-ProjectMemberTests-762530236 None] Lock "cinder-337f45f0-f1cd-4ba4-857e-ae30b487ebfd-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:15 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-673197ba-ee5c-430b-8948-62afa483507e" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Lock "cinder-quobyte-673197ba-ee5c-430b-8948-62afa483507e" released by "delete_volume" :: held 0.752s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Created reservations ['1cc61a74-03ee-4f62-b00d-4d6651aff3a3', '9a7baae6-8df8-43b0-b9d8-fcb27a5b74d2', 'bb745741-151d-492c-acbb-2569e7d5a852', '28b0a53e-c2f6-4e6f-927b-82af49c7188d'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:15 devstack sudo[106281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:10:15 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-47db8ae9-332b-41f1-90fc-31c0053ab93b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Lock "cinder-47db8ae9-332b-41f1-90fc-31c0053ab93b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-47db8ae9-332b-41f1-90fc-31c0053ab93b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-47db8ae9-332b-41f1-90fc-31c0053ab93b" acquired by "delete_volume" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c4a42c-a689-48ce-8483-1c8352045d7d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:15 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.321s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:10:15 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Deleted volume successfully.
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-0d30ac59-8c0d-4b1f-a5ed-f70532b3574d tempest-ProjectReaderTests-97541833 None] Lock "cinder-673197ba-ee5c-430b-8948-62afa483507e-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:15 devstack sudo[106284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b
Jul 14 18:10:15 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:15 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b" returned: 0 in 0.417s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:15 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b
Jul 14 18:10:15 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:16 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-47db8ae9-332b-41f1-90fc-31c0053ab93b" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-47db8ae9-332b-41f1-90fc-31c0053ab93b" released by "delete_volume" :: held 0.755s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:16 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Created reservations ['0488b7a3-8153-4f42-be73-beebc1cc1ba4', '1876d46a-174e-4324-9e26-812b3bb459b3', '35fb7618-4bf5-4312-a4dc-85841b9be516', '8083c896-c379-4414-8ff9-1a5a493fdf2c'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:16 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:16 devstack sudo[106292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:10:16 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:16 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:16 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:10:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Deleted volume successfully.
Jul 14 18:10:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-baf43cd3-74ca-42e6-8aa5-bbc23f8951b4 tempest-ProjectMemberTests-762530236 None] Lock "cinder-47db8ae9-332b-41f1-90fc-31c0053ab93b-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (7bfd6b3d-fadf-403a-885c-fd7768ddb0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7560920-58ba-4736-9992-c3c20dcfc119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7560920-58ba-4736-9992-c3c20dcfc119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801430452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c4b5df-4084-476b-ac52-cd641f090232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:17Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12a8e8d-eba2-4478-8852-39eab3ee73ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12a8e8d-eba2-4478-8852-39eab3ee73ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835da6fb-3d21-4ddb-b834-127940537d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835da6fb-3d21-4ddb-b834-127940537d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c4b5df-4084-476b-ac52-cd641f090232', 'volume_name': 'volume-20c4b5df-4084-476b-ac52-cd641f090232', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92c2765-49f3-43c8-b46c-b6497856caf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92c2765-49f3-43c8-b46c-b6497856caf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261f73f9-3330-4de4-a325-d474197b1350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:17 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Volume 20c4b5df-4084-476b-ac52-cd641f090232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c4b5df-4084-476b-ac52-cd641f090232', 'volume_size': 1}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801430452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c4b5df-4084-476b-ac52-cd641f090232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:17Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Creating volume 20c4b5df-4084-476b-ac52-cd641f090232 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:10:17 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:17 devstack sudo[106295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232 1073741824
Jul 14 18:10:17 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:17 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232 1073741824" returned: 0 in 0.569s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:17 devstack sudo[106301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232
Jul 14 18:10:17 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:18 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232" returned: 0 in 0.308s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:10:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261f73f9-3330-4de4-a325-d474197b1350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c4b5df-4084-476b-ac52-cd641f090232', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c704b2af-5851-475a-8b80-289e8dc981f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Volume volume-20c4b5df-4084-476b-ac52-cd641f090232 (20c4b5df-4084-476b-ac52-cd641f090232): created successfully
Jul 14 18:10:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c704b2af-5851-475a-8b80-289e8dc981f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (7bfd6b3d-fadf-403a-885c-fd7768ddb0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-e24c8ee1-cfe9-482c-8af9-7ab53139de4c tempest-ProjectMemberTests-762530236 None] Created volume successfully.
Jul 14 18:10:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] Creating offline snapshot 9e27181e-e3ce-48a7-8417-9b0e18091166 of volume 20c4b5df-4084-476b-ac52-cd641f090232 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:10:19 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d903d13-c1b6-4bd2-8fd7-8e4f2d80b4cf]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:19 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232
Jul 14 18:10:19 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:19 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232" returned: 0 in 0.418s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:19 devstack sudo[106310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166 1G
Jul 14 18:10:19 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:20 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166 1G" returned: 0 in 0.485s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c4b5df-4084-476b-ac52-cd641f090232 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:20 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c4b5df-4084-476b-ac52-cd641f090232 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166
Jul 14 18:10:20 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:20 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c4b5df-4084-476b-ac52-cd641f090232 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:20 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166 is being set with open permissions: ugo+rw
Jul 14 18:10:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:20 devstack sudo[106323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166
Jul 14 18:10:20 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:10:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:20 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:10:20 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:20 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166" returned: 0 in 0.283s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:21 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.info
Jul 14 18:10:21 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:21 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:10:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:10:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:10:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:10:21 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.info" returned: 0 in 0.273s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:21 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.info is being set with open permissions: ugo+rw
Jul 14 18:10:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:21 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.info
Jul 14 18:10:21 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:21 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.info" returned: 0 in 0.253s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.156s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-27e8bdfc-78f3-4c09-801f-7964fe807791 tempest-ProjectMemberTests-762530236 None] Create snapshot completed successfully
Jul 14 18:10:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-9e27181e-e3ce-48a7-8417-9b0e18091166-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Lock "cinder-9e27181e-e3ce-48a7-8417-9b0e18091166-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-20c4b5df-4084-476b-ac52-cd641f090232" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-20c4b5df-4084-476b-ac52-cd641f090232" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-9e27181e-e3ce-48a7-8417-9b0e18091166" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-9e27181e-e3ce-48a7-8417-9b0e18091166" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Deleting offline snapshot 9e27181e-e3ce-48a7-8417-9b0e18091166 of volume 20c4b5df-4084-476b-ac52-cd641f090232 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:10:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] snapshot_file for this snap is: volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:10:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[109e149e-cf1f-46c6-b812-0ab84d2c17f0]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:22 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166
Jul 14 18:10:22 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:23 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166" returned: 0 in 0.374s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:23 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20c4b5df-4084-476b-ac52-cd641f090232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:10:23 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[668c8df8-ec24-465c-ad0a-3a52610ba05b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:23 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232
Jul 14 18:10:23 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:23 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232" returned: 0 in 0.357s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:23 devstack sudo[106345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166
Jul 14 18:10:23 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:23 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166" returned: 0 in 0.324s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:23 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166
Jul 14 18:10:23 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:23 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232.9e27181e-e3ce-48a7-8417-9b0e18091166" returned: 0 in 0.237s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-9e27181e-e3ce-48a7-8417-9b0e18091166" released by "_delete_snapshot" :: held 1.383s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-20c4b5df-4084-476b-ac52-cd641f090232" released by "delete_snapshot" :: held 1.408s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:24 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Created reservations ['53f2e764-9ac6-4254-aa05-33b24b7070fe', '64ac1aa6-7040-4a49-8b1a-ebf1c800d2e7', 'c0bdb59f-4e64-4ad1-a933-746414019e7b', 'b5687d68-50ad-4def-bd78-1fb2c1ed44bf'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:24 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Delete snapshot completed successfully.
Jul 14 18:10:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-f42e57c4-5442-4d59-9d41-ef76f7d044aa tempest-ProjectMemberTests-762530236 None] Lock "cinder-9e27181e-e3ce-48a7-8417-9b0e18091166-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-20c4b5df-4084-476b-ac52-cd641f090232-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Lock "cinder-20c4b5df-4084-476b-ac52-cd641f090232-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-20c4b5df-4084-476b-ac52-cd641f090232" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-20c4b5df-4084-476b-ac52-cd641f090232" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3184b9f-9435-48c1-a6fc-f0519f0f9fc5]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:24 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232
Jul 14 18:10:24 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:25 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232" returned: 0 in 0.348s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:25 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232
Jul 14 18:10:25 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:25 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-20c4b5df-4084-476b-ac52-cd641f090232" returned: 0 in 0.240s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-20c4b5df-4084-476b-ac52-cd641f090232" released by "delete_volume" :: held 0.644s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Created reservations ['0770e08b-c2d6-4026-a379-9baa562c704c', '274dd38f-456f-4783-9e21-8ead02e200e4', '6cd1e7c2-47e3-459f-a526-db6e429925af', 'e7656ee7-3879-4d6f-a18a-6210032ace5e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:25 devstack sudo[106361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:10:25 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:25 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.239s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:10:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Deleted volume successfully.
Jul 14 18:10:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffea9e9c-8104-4c84-af77-45dd89eb90e4 tempest-ProjectMemberTests-762530236 None] Lock "cinder-20c4b5df-4084-476b-ac52-cd641f090232-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (11938689-b837-4471-a020-742d49fc5ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e753e55a-1fad-4a15-82d2-e047fe014fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e753e55a-1fad-4a15-82d2-e047fe014fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-43949547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ec16f9-1579-4821-a9ea-384dd3687dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:26Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c95244b-8607-4c3b-87f2-521e2231a974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c95244b-8607-4c3b-87f2-521e2231a974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18aa4d5e-7134-4045-b015-22a5f5107804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18aa4d5e-7134-4045-b015-22a5f5107804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ec16f9-1579-4821-a9ea-384dd3687dc2', 'volume_name': 'volume-44ec16f9-1579-4821-a9ea-384dd3687dc2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea76479-4341-4fae-b0b5-5a389cdf2019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea76479-4341-4fae-b0b5-5a389cdf2019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9113a6a9-e703-4cae-90dd-ee366e3cd729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Volume 44ec16f9-1579-4821-a9ea-384dd3687dc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ec16f9-1579-4821-a9ea-384dd3687dc2', 'volume_size': 1}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-43949547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ec16f9-1579-4821-a9ea-384dd3687dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:26Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Creating volume 44ec16f9-1579-4821-a9ea-384dd3687dc2 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:10:26 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:26 devstack sudo[106364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2 1073741824
Jul 14 18:10:26 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:26 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2 1073741824" returned: 0 in 0.408s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:26 devstack sudo[106369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2
Jul 14 18:10:26 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:27 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2" returned: 0 in 0.242s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9113a6a9-e703-4cae-90dd-ee366e3cd729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ec16f9-1579-4821-a9ea-384dd3687dc2', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1e8cfb-4041-47b8-baf9-b078be8b4374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:27 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Volume volume-44ec16f9-1579-4821-a9ea-384dd3687dc2 (44ec16f9-1579-4821-a9ea-384dd3687dc2): created successfully
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1e8cfb-4041-47b8-baf9-b078be8b4374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (11938689-b837-4471-a020-742d49fc5ff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:27 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f766e2bf-cd12-47c5-be78-0e0d0c40f206 tempest-ProjectMemberTests-762530236 None] Created volume successfully.
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] Creating offline snapshot ac133929-418d-4c80-a1e7-1fc00e3c9fe4 of volume 44ec16f9-1579-4821-a9ea-384dd3687dc2 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd36555-1f1b-43f3-958f-ddc73e15615c]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:27 devstack sudo[106372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2
Jul 14 18:10:27 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:27 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2" returned: 0 in 0.368s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:27 devstack sudo[106377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4 1G
Jul 14 18:10:27 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:28 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4 1G" returned: 0 in 0.406s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ec16f9-1579-4821-a9ea-384dd3687dc2 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:28 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ec16f9-1579-4821-a9ea-384dd3687dc2 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4
Jul 14 18:10:28 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:28 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44ec16f9-1579-4821-a9ea-384dd3687dc2 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:28 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4 is being set with open permissions: ugo+rw
Jul 14 18:10:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:28 devstack sudo[106387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4
Jul 14 18:10:28 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:28 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4" returned: 0 in 0.240s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:28 devstack sudo[106390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.info
Jul 14 18:10:28 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:29 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.info" returned: 0 in 0.255s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:29 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.info is being set with open permissions: ugo+rw
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:29 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.info
Jul 14 18:10:29 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:29 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.info" returned: 0 in 0.247s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:29 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fe867bee-4bd3-439c-8dc8-b51d9a6acd04 tempest-ProjectMemberTests-762530236 None] Create snapshot completed successfully
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-ac133929-418d-4c80-a1e7-1fc00e3c9fe4-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Lock "cinder-ac133929-418d-4c80-a1e7-1fc00e3c9fe4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-44ec16f9-1579-4821-a9ea-384dd3687dc2" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-44ec16f9-1579-4821-a9ea-384dd3687dc2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-ac133929-418d-4c80-a1e7-1fc00e3c9fe4" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-ac133929-418d-4c80-a1e7-1fc00e3c9fe4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Deleting offline snapshot ac133929-418d-4c80-a1e7-1fc00e3c9fe4 of volume 44ec16f9-1579-4821-a9ea-384dd3687dc2 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] snapshot_file for this snap is: volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e0c26f-22be-4e87-93b1-40c1dcece4c0]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:29 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4
Jul 14 18:10:29 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:30 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4" returned: 0 in 0.359s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:30 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44ec16f9-1579-4821-a9ea-384dd3687dc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:10:30 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf54643-98b3-419e-9c17-e410d56818bb]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:30 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2
Jul 14 18:10:30 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:30 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2" returned: 0 in 0.359s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:30 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4
Jul 14 18:10:30 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:30 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4" returned: 0 in 0.322s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:30 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4
Jul 14 18:10:30 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:30 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2.ac133929-418d-4c80-a1e7-1fc00e3c9fe4" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-ac133929-418d-4c80-a1e7-1fc00e3c9fe4" released by "_delete_snapshot" :: held 1.360s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-44ec16f9-1579-4821-a9ea-384dd3687dc2" released by "delete_snapshot" :: held 1.381s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:31 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Created reservations ['331825a3-4106-4011-bfc7-0d2086481da8', 'f393b939-af39-4599-b593-782fd1f444f4', 'd9b56e8d-5b3a-499b-a80a-2f40fe7bdfcb', '2055530d-91e5-448c-8c10-0991e7188e9a'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:31 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Delete snapshot completed successfully.
Jul 14 18:10:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-edfc0b4b-275f-4aff-b5d8-8bf065ae202c tempest-ProjectMemberTests-762530236 None] Lock "cinder-ac133929-418d-4c80-a1e7-1fc00e3c9fe4-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-44ec16f9-1579-4821-a9ea-384dd3687dc2-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Lock "cinder-44ec16f9-1579-4821-a9ea-384dd3687dc2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-44ec16f9-1579-4821-a9ea-384dd3687dc2" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-44ec16f9-1579-4821-a9ea-384dd3687dc2" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[70758635-4f72-421f-a096-ef12a502be0b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:31 devstack sudo[106415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2
Jul 14 18:10:31 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:32 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2" returned: 0 in 0.348s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:32 devstack sudo[106420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2
Jul 14 18:10:32 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:32 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-44ec16f9-1579-4821-a9ea-384dd3687dc2" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-44ec16f9-1579-4821-a9ea-384dd3687dc2" released by "delete_volume" :: held 0.653s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Created reservations ['e09c61ef-948d-43d2-8b7b-cc2ecc1b7b86', '35f7ccda-22cc-42a1-bf16-4681169f39fc', '45703656-3686-4189-b708-cfb0df996774', '3f011b0c-f2bb-4460-8d01-20bcba2d9a92'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:32 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:10:32 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:32 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.240s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:10:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Deleted volume successfully.
Jul 14 18:10:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a18ff8ed-d238-46d7-9586-567e63eef69d tempest-ProjectMemberTests-762530236 None] Lock "cinder-44ec16f9-1579-4821-a9ea-384dd3687dc2-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (da657f9b-fdd1-48c6-83f8-a967a777b2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982efda3-9413-4db6-a11c-5d421d013ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982efda3-9413-4db6-a11c-5d421d013ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2091297544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b683890-3aec-4ac0-a64f-b8c13c5ac4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:33Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423341f4-ecb7-4c17-aaaf-e72ed4fcc68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423341f4-ecb7-4c17-aaaf-e72ed4fcc68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16115385-4191-46fe-96b5-132913b180c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16115385-4191-46fe-96b5-132913b180c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b683890-3aec-4ac0-a64f-b8c13c5ac4be', 'volume_name': 'volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81db155-8251-4259-bfdc-00ca0ecaaffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81db155-8251-4259-bfdc-00ca0ecaaffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8222c7a-3995-44c2-b80f-00eac2e19c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Volume 3b683890-3aec-4ac0-a64f-b8c13c5ac4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be', 'volume_size': 1}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2091297544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b683890-3aec-4ac0-a64f-b8c13c5ac4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:33Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Creating volume 3b683890-3aec-4ac0-a64f-b8c13c5ac4be {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:10:33 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:33 devstack sudo[106426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be 1073741824
Jul 14 18:10:33 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:33 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be 1073741824" returned: 0 in 0.409s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:33 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be
Jul 14 18:10:33 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:34 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8222c7a-3995-44c2-b80f-00eac2e19c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6a9d7a-b197-4e56-801c-ff1517637b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:34 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Volume volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be (3b683890-3aec-4ac0-a64f-b8c13c5ac4be): created successfully
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6a9d7a-b197-4e56-801c-ff1517637b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (da657f9b-fdd1-48c6-83f8-a967a777b2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:34 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6eaa4a62-05c9-4ccf-86e6-5062f0b4825b tempest-ProjectMemberTests-762530236 None] Created volume successfully.
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] Creating offline snapshot 08b4ef65-171d-40a7-8288-c21db3116622 of volume 3b683890-3aec-4ac0-a64f-b8c13c5ac4be {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a287b8-b9c3-477e-91ce-17ea4a30c782]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:34 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be
Jul 14 18:10:34 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:34 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:34 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622 1G
Jul 14 18:10:34 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:35 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622 1G" returned: 0 in 0.386s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:35 devstack sudo[106445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622
Jul 14 18:10:35 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:35 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622" returned: 0 in 0.288s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:35 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622 is being set with open permissions: ugo+rw
Jul 14 18:10:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:35 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622
Jul 14 18:10:35 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:35 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622" returned: 0 in 0.238s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:35 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.info
Jul 14 18:10:35 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:36 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.info" returned: 0 in 0.270s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:36 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.info is being set with open permissions: ugo+rw
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:36 devstack sudo[106456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.info
Jul 14 18:10:36 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:36 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.info" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:36 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-42b1b7c2-fdd1-4ff7-a3dd-643c3b5e978b tempest-ProjectMemberTests-762530236 None] Create snapshot completed successfully
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-08b4ef65-171d-40a7-8288-c21db3116622-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Lock "cinder-08b4ef65-171d-40a7-8288-c21db3116622-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-3b683890-3aec-4ac0-a64f-b8c13c5ac4be" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-3b683890-3aec-4ac0-a64f-b8c13c5ac4be" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-08b4ef65-171d-40a7-8288-c21db3116622" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-08b4ef65-171d-40a7-8288-c21db3116622" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Deleting offline snapshot 08b4ef65-171d-40a7-8288-c21db3116622 of volume 3b683890-3aec-4ac0-a64f-b8c13c5ac4be {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] snapshot_file for this snap is: volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0033525a-2b89-4566-a347-75ca0c63cf68]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:36 devstack sudo[106459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622
Jul 14 18:10:36 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:37 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622" returned: 0 in 0.351s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:37 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:10:37 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ad3a7e-fb09-422b-9310-698e473a444d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:37 devstack sudo[106464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be
Jul 14 18:10:37 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:37 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be" returned: 0 in 0.370s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:37 devstack sudo[106469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622
Jul 14 18:10:37 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:37 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622" returned: 0 in 0.334s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:37 devstack sudo[106474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622
Jul 14 18:10:37 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:37 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be.08b4ef65-171d-40a7-8288-c21db3116622" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-08b4ef65-171d-40a7-8288-c21db3116622" released by "_delete_snapshot" :: held 1.382s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-3b683890-3aec-4ac0-a64f-b8c13c5ac4be" released by "delete_snapshot" :: held 1.403s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:38 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Created reservations ['2701e775-1f68-4ccd-a0a2-1e541d040d23', '0fb87a5c-b585-4514-888e-637979a6019a', '2c44def2-2ff0-4c2e-80b6-69f5388acb6a', '7dfa5be8-e772-42a1-a894-a3597280ca21'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:38 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Delete snapshot completed successfully.
Jul 14 18:10:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c5b7254c-873c-4215-b2d0-20dee6a2a7c7 tempest-ProjectMemberTests-762530236 None] Lock "cinder-08b4ef65-171d-40a7-8288-c21db3116622-delete_snapshot" released by "delete_snapshot" :: held 1.531s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-3b683890-3aec-4ac0-a64f-b8c13c5ac4be-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Lock "cinder-3b683890-3aec-4ac0-a64f-b8c13c5ac4be-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-3b683890-3aec-4ac0-a64f-b8c13c5ac4be" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-3b683890-3aec-4ac0-a64f-b8c13c5ac4be" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8007b04a-5488-4bb5-81b2-01968cfa7776]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:38 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be
Jul 14 18:10:38 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:39 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be" returned: 0 in 0.351s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:39 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be
Jul 14 18:10:39 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:39 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-3b683890-3aec-4ac0-a64f-b8c13c5ac4be" returned: 0 in 0.237s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-3b683890-3aec-4ac0-a64f-b8c13c5ac4be" released by "delete_volume" :: held 0.643s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Created reservations ['a9e30527-a514-42be-83ae-78c29c7352f0', '31de40cc-10d6-4531-9e2f-6efa5a004148', 'f62ca6d7-2659-41e6-a65b-bd2a1b3375a8', '101512c6-f5a9-414f-ab25-3d1ab86101d3'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:39 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:10:39 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:39 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.228s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:10:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Deleted volume successfully.
Jul 14 18:10:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-bede5eab-5740-4021-a5ad-3462f7e34edd tempest-ProjectMemberTests-762530236 None] Lock "cinder-3b683890-3aec-4ac0-a64f-b8c13c5ac4be-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (1a24b857-92db-4a46-8519-53fe7fb56fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a6f6b3-faf1-495d-8338-91ca6f0a23d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a6f6b3-faf1-495d-8338-91ca6f0a23d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-755540320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d694c095-df52-42a1-82cd-930adcfda5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:40Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00d699f-c7cd-42e2-8d04-915164b01b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00d699f-c7cd-42e2-8d04-915164b01b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4d2691-3c38-4446-acf8-913b79270284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4d2691-3c38-4446-acf8-913b79270284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd694c095-df52-42a1-82cd-930adcfda5a4', 'volume_name': 'volume-d694c095-df52-42a1-82cd-930adcfda5a4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b61ee0e-9935-46ae-8104-485bb3e094fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b61ee0e-9935-46ae-8104-485bb3e094fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2d30a1-72c4-4b99-a215-2acfee5ac474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:40 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Volume d694c095-df52-42a1-82cd-930adcfda5a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d694c095-df52-42a1-82cd-930adcfda5a4', 'volume_size': 1}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-755540320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d694c095-df52-42a1-82cd-930adcfda5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:40Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Creating volume d694c095-df52-42a1-82cd-930adcfda5a4 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:10:40 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:40 devstack sudo[106489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4 1073741824
Jul 14 18:10:40 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:40 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4 1073741824" returned: 0 in 0.407s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:40 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:40 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4
Jul 14 18:10:40 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:41 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2d30a1-72c4-4b99-a215-2acfee5ac474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d694c095-df52-42a1-82cd-930adcfda5a4', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60045e9-f3c0-431a-9d36-a76d7409420c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:41 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Volume volume-d694c095-df52-42a1-82cd-930adcfda5a4 (d694c095-df52-42a1-82cd-930adcfda5a4): created successfully
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60045e9-f3c0-431a-9d36-a76d7409420c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (1a24b857-92db-4a46-8519-53fe7fb56fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:41 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-241c52b9-ef41-4ef2-a8ee-37f205675312 tempest-ProjectMemberTests-762530236 None] Created volume successfully.
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] Creating offline snapshot 81c33fae-d878-49c3-a730-42ad5fe560cd of volume d694c095-df52-42a1-82cd-930adcfda5a4 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd1fe95-77ac-48c9-ad83-22b4878e3b90]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:41 devstack sudo[106498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4
Jul 14 18:10:41 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:41 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4" returned: 0 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:41 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:41 devstack sudo[106503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd 1G
Jul 14 18:10:41 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:42 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd 1G" returned: 0 in 0.390s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d694c095-df52-42a1-82cd-930adcfda5a4 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:42 devstack sudo[106509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d694c095-df52-42a1-82cd-930adcfda5a4 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd
Jul 14 18:10:42 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:42 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d694c095-df52-42a1-82cd-930adcfda5a4 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd" returned: 0 in 0.292s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:42 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd is being set with open permissions: ugo+rw
Jul 14 18:10:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:42 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd
Jul 14 18:10:42 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:42 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd" returned: 0 in 0.233s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:42 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:42 devstack sudo[106518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.info
Jul 14 18:10:42 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:43 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.info" returned: 0 in 0.267s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:43 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.info is being set with open permissions: ugo+rw
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:43 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.info
Jul 14 18:10:43 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:43 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.info" returned: 0 in 0.258s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:43 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-efb7f48c-d56a-4ee6-a797-6427359baba8 tempest-ProjectMemberTests-762530236 None] Create snapshot completed successfully
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-81c33fae-d878-49c3-a730-42ad5fe560cd-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Lock "cinder-81c33fae-d878-49c3-a730-42ad5fe560cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-d694c095-df52-42a1-82cd-930adcfda5a4" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-d694c095-df52-42a1-82cd-930adcfda5a4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-81c33fae-d878-49c3-a730-42ad5fe560cd" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-81c33fae-d878-49c3-a730-42ad5fe560cd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Deleting offline snapshot 81c33fae-d878-49c3-a730-42ad5fe560cd of volume d694c095-df52-42a1-82cd-930adcfda5a4 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] snapshot_file for this snap is: volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db93674-bcd4-484b-8b47-c640cfbd1430]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:43 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:43 devstack sudo[106558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd
Jul 14 18:10:43 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:44 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd" returned: 0 in 0.387s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:44 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d694c095-df52-42a1-82cd-930adcfda5a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:10:44 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a765ab2f-5af9-4029-a5ad-52dbbf7affb9]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:44 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4
Jul 14 18:10:44 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:44 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4" returned: 0 in 0.356s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:44 devstack sudo[106570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd
Jul 14 18:10:44 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:44 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:44 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:44 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd
Jul 14 18:10:44 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:45 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4.81c33fae-d878-49c3-a730-42ad5fe560cd" returned: 0 in 0.253s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-81c33fae-d878-49c3-a730-42ad5fe560cd" released by "_delete_snapshot" :: held 1.425s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-d694c095-df52-42a1-82cd-930adcfda5a4" released by "delete_snapshot" :: held 1.452s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:45 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Created reservations ['de9ee51f-daed-4e6e-89ab-c8ef077dbb66', 'bb3c74b9-2fa9-40c6-923c-3535f8da1cf0', 'fcac95e5-524f-4940-9159-e331ad1d1da8', '6bbd88cd-1e40-45c2-bb99-2f6e100b4157'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:45 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Delete snapshot completed successfully.
Jul 14 18:10:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ffb26190-c954-462a-aff4-eef1bb7b18ff tempest-ProjectMemberTests-762530236 None] Lock "cinder-81c33fae-d878-49c3-a730-42ad5fe560cd-delete_snapshot" released by "delete_snapshot" :: held 1.597s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-d694c095-df52-42a1-82cd-930adcfda5a4-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Lock "cinder-d694c095-df52-42a1-82cd-930adcfda5a4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-d694c095-df52-42a1-82cd-930adcfda5a4" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:45 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-d694c095-df52-42a1-82cd-930adcfda5a4" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:45 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ac0f4d-4714-4f6b-a716-493227f4e890]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:45 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:45 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4
Jul 14 18:10:45 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:46 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4" returned: 0 in 0.346s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:46 devstack sudo[106583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4
Jul 14 18:10:46 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:46 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-d694c095-df52-42a1-82cd-930adcfda5a4" returned: 0 in 0.251s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-d694c095-df52-42a1-82cd-930adcfda5a4" released by "delete_volume" :: held 0.650s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Created reservations ['39d87d1d-7e4f-4472-acff-6a4f9ba59802', '0e70c6cc-140b-4a25-aef5-05088d0dfdca', 'ef66defc-6d55-4a26-a56c-ce9c2718480c', '9df5c1f0-9240-4bda-885f-5aaab5687cd5'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:46 devstack sudo[106586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:10:46 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:46 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.260s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:10:46 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Deleted volume successfully.
Jul 14 18:10:46 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-3d83a530-827e-48fa-9f76-5db7994a0e25 tempest-ProjectMemberTests-762530236 None] Lock "cinder-d694c095-df52-42a1-82cd-930adcfda5a4-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (393da345-b68c-4e87-a3d7-bbb537da0961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5411cba2-4fc9-4004-a456-2d4afa9193e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5411cba2-4fc9-4004-a456-2d4afa9193e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2112567913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fdccce-cc38-4e73-9fc9-7fdc9956a2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:47Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9332872a-cd15-49cd-bf06-fa4bf07978dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9332872a-cd15-49cd-bf06-fa4bf07978dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be95ace1-ddc5-44ca-bcbd-defe7a3ff24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be95ace1-ddc5-44ca-bcbd-defe7a3ff24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36fdccce-cc38-4e73-9fc9-7fdc9956a2b8', 'volume_name': 'volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6296d7-bed5-458e-a1dc-6b0685f093c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6296d7-bed5-458e-a1dc-6b0685f093c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2c4f16-4a9b-4060-a4cb-2a4394259960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:47 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Volume 36fdccce-cc38-4e73-9fc9-7fdc9956a2b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8', 'volume_size': 1}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2112567913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fdccce-cc38-4e73-9fc9-7fdc9956a2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:47Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Creating volume 36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:10:47 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:47 devstack sudo[106589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 1073741824
Jul 14 18:10:47 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:47 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 1073741824" returned: 0 in 0.414s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:47 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:47 devstack sudo[106595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8
Jul 14 18:10:47 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:48 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8" returned: 0 in 0.238s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2c4f16-4a9b-4060-a4cb-2a4394259960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5394b562-4628-46c3-80d0-d83518e6538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:48 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Volume volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 (36fdccce-cc38-4e73-9fc9-7fdc9956a2b8): created successfully
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5394b562-4628-46c3-80d0-d83518e6538c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (393da345-b68c-4e87-a3d7-bbb537da0961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:48 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-97a3bf52-7d43-4afd-9aee-72185daba466 tempest-ProjectMemberTests-762530236 None] Created volume successfully.
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] Creating offline snapshot 4e13a26d-672f-4bde-a5af-1b499093fa19 of volume 36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d527967-a499-4802-99ed-9dbac1f54501]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:48 devstack sudo[106598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8
Jul 14 18:10:48 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:48 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:48 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:48 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19 1G
Jul 14 18:10:48 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:49 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19 1G" returned: 0 in 0.433s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:49 devstack sudo[106609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19
Jul 14 18:10:49 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:49 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19" returned: 0 in 0.317s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:49 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19 is being set with open permissions: ugo+rw
Jul 14 18:10:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:49 devstack sudo[106615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19
Jul 14 18:10:49 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:49 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19" returned: 0 in 0.258s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:49 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=158,cinder:INSERT=61,cinder:UPDATE=222,cinder:DELETE=17 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:10:49 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:49 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.info
Jul 14 18:10:49 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:50 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.info" returned: 0 in 0.267s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:50 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.info is being set with open permissions: ugo+rw
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:50 devstack sudo[106622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.info
Jul 14 18:10:50 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:50 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.info" returned: 0 in 0.251s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:50 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d96553c6-7058-4dbf-84db-066e68b960a4 tempest-ProjectMemberTests-762530236 None] Create snapshot completed successfully
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-4e13a26d-672f-4bde-a5af-1b499093fa19-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Lock "cinder-4e13a26d-672f-4bde-a5af-1b499093fa19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-4e13a26d-672f-4bde-a5af-1b499093fa19" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-4e13a26d-672f-4bde-a5af-1b499093fa19" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Deleting offline snapshot 4e13a26d-672f-4bde-a5af-1b499093fa19 of volume 36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] snapshot_file for this snap is: volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfee83d-ef43-453a-b133-3c5cecc07dc2]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:50 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:50 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19
Jul 14 18:10:50 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:51 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19" returned: 0 in 0.375s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:51 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:10:51 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8a1a55-00ff-4eec-89e6-71eadb573692]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:51 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8
Jul 14 18:10:51 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:51 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8" returned: 0 in 0.370s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:51 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19
Jul 14 18:10:51 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:51 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19" returned: 0 in 0.329s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:51 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:51 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19
Jul 14 18:10:51 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:52 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8.4e13a26d-672f-4bde-a5af-1b499093fa19" returned: 0 in 0.242s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-4e13a26d-672f-4bde-a5af-1b499093fa19" released by "_delete_snapshot" :: held 1.410s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8" released by "delete_snapshot" :: held 1.434s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:52 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Created reservations ['825fce5f-5604-4580-846e-fc7bef622efc', 'c4e11a1e-5798-41cc-b14f-308bbce91c43', '0f8c50a5-84ee-4a68-b0c4-2b5e54da2a3a', 'bd19de1c-fe55-41db-a79b-10159af77725'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:52 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Delete snapshot completed successfully.
Jul 14 18:10:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-ae4e7831-1e7a-4464-8aea-0478bb93ca96 tempest-ProjectMemberTests-762530236 None] Lock "cinder-4e13a26d-672f-4bde-a5af-1b499093fa19-delete_snapshot" released by "delete_snapshot" :: held 1.565s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Lock "cinder-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:52 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:52 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[215051de-ecdf-4077-9c34-2b25d0cd154c]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:52 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:53 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8
Jul 14 18:10:53 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:53 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8" returned: 0 in 0.367s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:53 devstack sudo[106649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8
Jul 14 18:10:53 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:53 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8" returned: 0 in 0.255s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8" released by "delete_volume" :: held 0.677s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Created reservations ['62bc33dd-bc50-4853-a707-f6bfb9237047', 'f4fce63a-cde8-4953-be8b-6ea77edc2195', 'd8158b1e-cce5-4cb8-860d-a253ca3eac9a', 'd9a25a06-7612-4fce-ae2d-efcb8de49b95'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:53 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:10:53 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:53 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.246s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:10:53 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Deleted volume successfully.
Jul 14 18:10:53 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-26b5ab14-644c-4c42-90b6-2e6676c743fa tempest-ProjectMemberTests-762530236 None] Lock "cinder-36fdccce-cc38-4e73-9fc9-7fdc9956a2b8-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:DELETE=15,cinder:SELECT=139,cinder:INSERT=46,cinder:UPDATE=193 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (aaefc0a3-252d-4ab8-8ad5-00bbd1f14145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b19e25-3955-402a-81c4-e49955e273de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b19e25-3955-402a-81c4-e49955e273de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-180948419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2dae36-574c-4632-80f7-e250352330be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:54Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a984c31b-881d-43c4-bc30-c38b94c0cfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a984c31b-881d-43c4-bc30-c38b94c0cfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d67e24-90f4-439b-88c0-7abe943c32e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d67e24-90f4-439b-88c0-7abe943c32e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f2dae36-574c-4632-80f7-e250352330be', 'volume_name': 'volume-6f2dae36-574c-4632-80f7-e250352330be', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55762698-9a94-4cb3-b018-22a30d0fca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55762698-9a94-4cb3-b018-22a30d0fca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19810b57-6425-470e-990e-92ac6d429af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:54 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Volume 6f2dae36-574c-4632-80f7-e250352330be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f2dae36-574c-4632-80f7-e250352330be', 'volume_size': 1}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-180948419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2dae36-574c-4632-80f7-e250352330be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d31f392cc5b4f1983a7b3279af23c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:10:54Z,use_quota=True,user_id='949a63df8f8746ada3b46abe70a1719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Creating volume 6f2dae36-574c-4632-80f7-e250352330be {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:10:54 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:54 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be 1073741824
Jul 14 18:10:54 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:54 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be 1073741824" returned: 0 in 0.417s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:54 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:54 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be
Jul 14 18:10:54 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:55 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be" returned: 0 in 0.248s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19810b57-6425-470e-990e-92ac6d429af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2dae36-574c-4632-80f7-e250352330be', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdcf3e9-d2c2-410f-819b-62040d84ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:10:55 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Volume volume-6f2dae36-574c-4632-80f7-e250352330be (6f2dae36-574c-4632-80f7-e250352330be): created successfully
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdcf3e9-d2c2-410f-819b-62040d84ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Flow 'volume_create_manager' (aaefc0a3-252d-4ab8-8ad5-00bbd1f14145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:10:55 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7b9e8e59-9414-4660-85c2-2b5c7b4b0852 tempest-ProjectMemberTests-762530236 None] Created volume successfully.
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] Creating offline snapshot 5647cf60-26be-4241-88f4-23f9a134a8fb of volume 6f2dae36-574c-4632-80f7-e250352330be {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45d3301-edbd-442b-a1d9-6c495f5ef159]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:55 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be
Jul 14 18:10:55 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:55 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be" returned: 0 in 0.348s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:55 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:55 devstack sudo[106675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb 1G
Jul 14 18:10:55 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:56 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb 1G" returned: 0 in 0.389s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f2dae36-574c-4632-80f7-e250352330be -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:56 devstack sudo[106681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f2dae36-574c-4632-80f7-e250352330be -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb
Jul 14 18:10:56 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:56 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f2dae36-574c-4632-80f7-e250352330be -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb" returned: 0 in 0.306s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:56 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb is being set with open permissions: ugo+rw
Jul 14 18:10:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:56 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb
Jul 14 18:10:56 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:56 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb" returned: 0 in 0.238s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:56 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:56 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.info
Jul 14 18:10:56 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:57 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.info" returned: 0 in 0.245s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:57 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.info is being set with open permissions: ugo+rw
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:57 devstack sudo[106692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.info
Jul 14 18:10:57 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:57 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.info" returned: 0 in 0.240s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:10:57 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-4bccfe9e-e06a-49c8-a6be-b83cd07eea30 tempest-ProjectMemberTests-762530236 None] Create snapshot completed successfully
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-5647cf60-26be-4241-88f4-23f9a134a8fb-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Lock "cinder-5647cf60-26be-4241-88f4-23f9a134a8fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-6f2dae36-574c-4632-80f7-e250352330be" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-6f2dae36-574c-4632-80f7-e250352330be" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-5647cf60-26be-4241-88f4-23f9a134a8fb" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-5647cf60-26be-4241-88f4-23f9a134a8fb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Deleting offline snapshot 5647cf60-26be-4241-88f4-23f9a134a8fb of volume 6f2dae36-574c-4632-80f7-e250352330be {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] snapshot_file for this snap is: volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bddc90-248a-455d-9eb7-48499f7e75bb]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:57 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:57 devstack sudo[106695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb
Jul 14 18:10:57 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:58 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb" returned: 0 in 0.349s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:58 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f2dae36-574c-4632-80f7-e250352330be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:10:58 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d205e0-260e-4200-86f3-ad2edc9b7041]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:10:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:58 devstack sudo[106700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be
Jul 14 18:10:58 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:58 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be" returned: 0 in 0.341s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:58 devstack sudo[106705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb
Jul 14 18:10:58 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:58 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb" returned: 0 in 0.347s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:58 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:10:58 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb
Jul 14 18:10:58 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:10:59 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Jul 14 18:10:59 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be.5647cf60-26be-4241-88f4-23f9a134a8fb" returned: 0 in 0.240s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:10:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-5647cf60-26be-4241-88f4-23f9a134a8fb" released by "_delete_snapshot" :: held 1.361s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-6f2dae36-574c-4632-80f7-e250352330be" released by "delete_snapshot" :: held 1.381s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:59 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Created reservations ['c8c73d28-75b1-4dc3-977c-e2798ad2c815', 'b7b7cfc3-9ea2-42a2-9bc3-acf665a89a5a', 'eb0e2a93-e8b1-46ee-8356-cfd683fcf337', '03de445c-ac11-4249-b87a-41cc5efbf3fe'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:10:59 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Delete snapshot completed successfully.
Jul 14 18:10:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-fe8206e9-6ae4-4cae-941f-65c9cc17e7b0 tempest-ProjectMemberTests-762530236 None] Lock "cinder-5647cf60-26be-4241-88f4-23f9a134a8fb-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:10:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-6f2dae36-574c-4632-80f7-e250352330be-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Lock "cinder-6f2dae36-574c-4632-80f7-e250352330be-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:10:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Acquiring lock "cinder-quobyte-6f2dae36-574c-4632-80f7-e250352330be" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:10:59 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-6f2dae36-574c-4632-80f7-e250352330be" acquired by "delete_volume" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7e3c87-378a-4b80-82d1-7f06c319fbbd]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:00 devstack sudo[106714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be
Jul 14 18:11:00 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:00 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be" returned: 0 in 0.386s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:00 devstack sudo[106720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be
Jul 14 18:11:00 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:00 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-6f2dae36-574c-4632-80f7-e250352330be" returned: 0 in 0.256s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Lock "cinder-quobyte-6f2dae36-574c-4632-80f7-e250352330be" released by "delete_volume" :: held 0.698s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Created reservations ['f9912b65-1e62-42bb-975a-c78cce182b18', '3a394758-f96d-462a-b418-e2f5b49c803a', '90bc67be-fa74-4cd1-9712-5690b651f766', 'e5b1a34e-a76a-41e3-96bf-bcd35620b040'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:00 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:11:00 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:01 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.249s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:01 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:11:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Deleted volume successfully.
Jul 14 18:11:01 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-7fa673b4-528a-4544-827d-dd40c8399349 tempest-ProjectMemberTests-762530236 None] Lock "cinder-6f2dae36-574c-4632-80f7-e250352330be-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Flow 'volume_create_manager' (0f409710-21be-4402-a1e8-c7973b7a0e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a8e78f-1e4f-472b-8ab3-58329c2455b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a8e78f-1e4f-472b-8ab3-58329c2455b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-40878358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1b928a-ae4a-4ede-bbec-6ffa496d3141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3c0ed7bc5841beaf944ae1b7ed0437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:11:05Z,use_quota=True,user_id='8d3affeda7d2484e9982ddbdd9c030ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e161abd-54a8-487e-ac7c-cae99497c0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e161abd-54a8-487e-ac7c-cae99497c0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae9e370-7105-412e-909e-8846daa0ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae9e370-7105-412e-909e-8846daa0ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec1b928a-ae4a-4ede-bbec-6ffa496d3141', 'volume_name': 'volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce25866b-a525-41d8-832e-c7d859a5d46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce25866b-a525-41d8-832e-c7d859a5d46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53319134-25e8-4354-bd3e-45419d2ab928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Volume ec1b928a-ae4a-4ede-bbec-6ffa496d3141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141', 'volume_size': 1}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-40878358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1b928a-ae4a-4ede-bbec-6ffa496d3141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3c0ed7bc5841beaf944ae1b7ed0437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:11:05Z,use_quota=True,user_id='8d3affeda7d2484e9982ddbdd9c030ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Creating volume ec1b928a-ae4a-4ede-bbec-6ffa496d3141 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:11:04 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:11:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:04 devstack sudo[106727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141 1073741824
Jul 14 18:11:04 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:05 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141 1073741824" returned: 0 in 0.392s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:05 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141
Jul 14 18:11:05 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:05 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141" returned: 0 in 0.228s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] <== create_volume: return (658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53319134-25e8-4354-bd3e-45419d2ab928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efde7e5-6a8f-46e7-b174-afc3aafda8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:05 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Volume volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141 (ec1b928a-ae4a-4ede-bbec-6ffa496d3141): created successfully
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efde7e5-6a8f-46e7-b174-afc3aafda8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Flow 'volume_create_manager' (0f409710-21be-4402-a1e8-c7973b7a0e52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:11:05 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-f882bf0e-9318-4f99-a9d5-5dc0d5387539 tempest-ProjectReaderTests-2070842488 None] Created volume successfully.
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] Creating offline snapshot e20bddce-a426-4138-bc8d-c4e65d85163a of volume ec1b928a-ae4a-4ede-bbec-6ffa496d3141 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf664a60-9a3e-4c28-928e-6968b4113b2a]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:05 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141
Jul 14 18:11:05 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:06 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141" returned: 0 in 0.346s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:06 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a 1G
Jul 14 18:11:06 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:06 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a 1G" returned: 0 in 0.372s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:06 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a
Jul 14 18:11:06 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:06 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a" returned: 0 in 0.287s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:06 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a is being set with open permissions: ugo+rw
Jul 14 18:11:06 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:06 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a
Jul 14 18:11:06 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:07 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a" returned: 0 in 0.227s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:07 devstack sudo[106754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.info
Jul 14 18:11:07 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:07 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.info" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:07 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.info is being set with open permissions: ugo+rw
Jul 14 18:11:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:07 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.info
Jul 14 18:11:07 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:07 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.info" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:07 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.789s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:07 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-19664043-4209-4ccf-b126-a02a5854512d tempest-ProjectReaderTests-2070842488 None] Create snapshot completed successfully
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-e20bddce-a426-4138-bc8d-c4e65d85163a-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-e20bddce-a426-4138-bc8d-c4e65d85163a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-ec1b928a-ae4a-4ede-bbec-6ffa496d3141" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-ec1b928a-ae4a-4ede-bbec-6ffa496d3141" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-e20bddce-a426-4138-bc8d-c4e65d85163a" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-e20bddce-a426-4138-bc8d-c4e65d85163a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Deleting offline snapshot e20bddce-a426-4138-bc8d-c4e65d85163a of volume ec1b928a-ae4a-4ede-bbec-6ffa496d3141 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] snapshot_file for this snap is: volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea0ce59-3f8a-4b97-9881-5be5176e4695]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:08 devstack sudo[106760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a
Jul 14 18:11:08 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:08 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a" returned: 0 in 0.347s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[62159855-4e0f-45a6-bbec-9ff4b0d53983]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:08 devstack sudo[106765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141
Jul 14 18:11:08 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:08 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:08 devstack sudo[106770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a
Jul 14 18:11:08 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:09 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a" returned: 0 in 0.311s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:09 devstack sudo[106775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a
Jul 14 18:11:09 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:09 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141.e20bddce-a426-4138-bc8d-c4e65d85163a" returned: 0 in 0.239s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-e20bddce-a426-4138-bc8d-c4e65d85163a" released by "_delete_snapshot" :: held 1.319s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-ec1b928a-ae4a-4ede-bbec-6ffa496d3141" released by "delete_snapshot" :: held 1.340s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:09 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Created reservations ['e00d557e-8332-4d62-a512-ef9f8e58358c', 'e9ad3c17-8d68-473d-9908-65893fc8e75a', '3c1d33b5-35bc-453e-8be5-ed3d4d749d03', '56358137-eb19-4a8a-b1a1-7c747f2a9a3e'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:11:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Delete snapshot completed successfully.
Jul 14 18:11:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a33d7377-4292-432d-a0aa-f163b9c43b18 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-e20bddce-a426-4138-bc8d-c4e65d85163a-delete_snapshot" released by "delete_snapshot" :: held 1.461s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-ec1b928a-ae4a-4ede-bbec-6ffa496d3141-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-ec1b928a-ae4a-4ede-bbec-6ffa496d3141-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-ec1b928a-ae4a-4ede-bbec-6ffa496d3141" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-ec1b928a-ae4a-4ede-bbec-6ffa496d3141" acquired by "delete_volume" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea28b576-2071-475a-bccc-03621f4131e6]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:10 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141
Jul 14 18:11:10 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:10 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141" returned: 0 in 0.340s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:10 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141
Jul 14 18:11:10 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:10 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-ec1b928a-ae4a-4ede-bbec-6ffa496d3141" returned: 0 in 0.230s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-ec1b928a-ae4a-4ede-bbec-6ffa496d3141" released by "delete_volume" :: held 0.623s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Created reservations ['df7ce2e1-5b13-4e87-bb84-2f6dce6addd0', 'cd41f5cd-785c-4d58-b8c3-3f593cb168e2', 'f23410ca-71d6-47e2-be22-d55e837bab48', 'ee1bf84b-346f-4c9c-b066-42c3ff4c6555'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:10 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:11:10 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:11 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:11:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Deleted volume successfully.
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2458417e-89b2-4093-994e-befdbb3b8873 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-ec1b928a-ae4a-4ede-bbec-6ffa496d3141-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Flow 'volume_create_manager' (c7d06c40-6621-4496-8038-a38ca8c14d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd9c2f3-fc8a-4a4b-9970-46f0cc34c630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd9c2f3-fc8a-4a4b-9970-46f0cc34c630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-322932994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba1fd12-7c1a-4411-a15b-cc7cf85c144f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3c0ed7bc5841beaf944ae1b7ed0437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:11:12Z,use_quota=True,user_id='8d3affeda7d2484e9982ddbdd9c030ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888cfe09-eea3-4a39-8aee-43af8d88f367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888cfe09-eea3-4a39-8aee-43af8d88f367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3411e0db-b945-4e8e-8721-74c804dc39f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3411e0db-b945-4e8e-8721-74c804dc39f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba1fd12-7c1a-4411-a15b-cc7cf85c144f', 'volume_name': 'volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b31417e-2324-47b6-8706-ff8df2b8b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b31417e-2324-47b6-8706-ff8df2b8b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1cb39f5-0e7f-4354-a31f-a43c3c3e3e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:11 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Volume 4ba1fd12-7c1a-4411-a15b-cc7cf85c144f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f', 'volume_size': 1}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-322932994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba1fd12-7c1a-4411-a15b-cc7cf85c144f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3c0ed7bc5841beaf944ae1b7ed0437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:11:12Z,use_quota=True,user_id='8d3affeda7d2484e9982ddbdd9c030ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Creating volume 4ba1fd12-7c1a-4411-a15b-cc7cf85c144f {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:11:11 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:11:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:11 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f 1073741824
Jul 14 18:11:11 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:12 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f 1073741824" returned: 0 in 0.388s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:12 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f
Jul 14 18:11:12 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:12 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f" returned: 0 in 0.239s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1cb39f5-0e7f-4354-a31f-a43c3c3e3e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49eab3c0-44fb-443f-90ac-504c4898e887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:12 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Volume volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f (4ba1fd12-7c1a-4411-a15b-cc7cf85c144f): created successfully
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49eab3c0-44fb-443f-90ac-504c4898e887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Flow 'volume_create_manager' (c7d06c40-6621-4496-8038-a38ca8c14d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:11:12 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-6bbc45cc-d332-43c8-8271-ebf48215bbf3 tempest-ProjectReaderTests-2070842488 None] Created volume successfully.
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] Creating offline snapshot 554cc4ee-46f2-4801-9691-4a347ff72c96 of volume 4ba1fd12-7c1a-4411-a15b-cc7cf85c144f {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cc72d7-526a-4e20-b2b1-b5b78f6148d6]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:13 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f
Jul 14 18:11:13 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:13 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:13 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96 1G
Jul 14 18:11:13 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:13 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96 1G" returned: 0 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:13 devstack sudo[106814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96
Jul 14 18:11:13 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:13 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96" returned: 0 in 0.283s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:13 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96 is being set with open permissions: ugo+rw
Jul 14 18:11:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:14 devstack sudo[106819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96
Jul 14 18:11:14 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:14 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96" returned: 0 in 0.232s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:14 devstack sudo[106824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.info
Jul 14 18:11:14 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:14 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.info" returned: 0 in 0.248s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:14 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.info is being set with open permissions: ugo+rw
Jul 14 18:11:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:14 devstack sudo[106827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.info
Jul 14 18:11:14 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:14 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.info" returned: 0 in 0.226s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.792s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-766ccc9e-d493-40e0-b5ec-42b14b53073f tempest-ProjectReaderTests-2070842488 None] Create snapshot completed successfully
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-554cc4ee-46f2-4801-9691-4a347ff72c96-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Lock "cinder-554cc4ee-46f2-4801-9691-4a347ff72c96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-554cc4ee-46f2-4801-9691-4a347ff72c96" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-554cc4ee-46f2-4801-9691-4a347ff72c96" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Deleting offline snapshot 554cc4ee-46f2-4801-9691-4a347ff72c96 of volume 4ba1fd12-7c1a-4411-a15b-cc7cf85c144f {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] snapshot_file for this snap is: volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d6ce70-b50c-422f-a967-b97237eaad42]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:15 devstack sudo[106830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96
Jul 14 18:11:15 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:15 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[4938831e-9d3d-4684-a89e-0ad948d4a4ad]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:15 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f
Jul 14 18:11:15 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:15 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f" returned: 0 in 0.328s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:15 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:15 devstack sudo[106840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96
Jul 14 18:11:15 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:16 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96" returned: 0 in 0.319s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:16 devstack sudo[106845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96
Jul 14 18:11:16 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:16 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:16 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f.554cc4ee-46f2-4801-9691-4a347ff72c96" returned: 0 in 0.245s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-554cc4ee-46f2-4801-9691-4a347ff72c96" released by "_delete_snapshot" :: held 1.316s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f" released by "delete_snapshot" :: held 1.335s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:16 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Created reservations ['b17497b0-9095-4651-919e-99319b545add', 'b87f9368-b311-4d31-a92b-e44f7a7cf046', '62d2cf8d-4f8e-49ea-8ca1-9e5df71c090e', 'a219a0b0-9ff1-498f-b994-cc81f0c4b9dc'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:11:16 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Delete snapshot completed successfully.
Jul 14 18:11:16 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c012512d-05b2-4794-935e-5f5b9c703e8d tempest-ProjectReaderTests-2070842488 None] Lock "cinder-554cc4ee-46f2-4801-9691-4a347ff72c96-delete_snapshot" released by "delete_snapshot" :: held 1.464s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:17 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e8c432-19a3-4cc3-b556-56758bcfeec3]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:17 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f
Jul 14 18:11:17 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:17 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f" returned: 0 in 0.357s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:17 devstack sudo[106853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f
Jul 14 18:11:17 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:17 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:17 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f" returned: 0 in 0.240s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:17 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f" released by "delete_volume" :: held 0.670s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:17 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Created reservations ['0d24e05a-c9bb-4c76-8a02-20d0cbdf94de', '127d3496-8fd6-4afd-8c6d-517d8e56112a', 'f2354f37-4df5-42f2-9e06-6684183bb571', 'b12588f2-13c5-473d-9c74-01ea3e2d9782'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:18 devstack sudo[106856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:11:18 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:18 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.274s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:11:18 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Deleted volume successfully.
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9a42b1f7-bbcd-46f1-a306-a2f124cf9792 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-4ba1fd12-7c1a-4411-a15b-cc7cf85c144f-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Flow 'volume_create_manager' (5ed6185e-d986-446b-a8f2-bd8a2b641a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65668e0-85bc-4b05-a5ee-17f6cf4f32af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65668e0-85bc-4b05-a5ee-17f6cf4f32af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739115564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60043f5f-94f5-4395-a0ab-ea907208e51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3c0ed7bc5841beaf944ae1b7ed0437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:11:19Z,use_quota=True,user_id='8d3affeda7d2484e9982ddbdd9c030ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b8acf2-7e6e-45d9-a5b3-658f891ec2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b8acf2-7e6e-45d9-a5b3-658f891ec2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74800e4-af11-4816-a11e-1f0198ad1fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74800e4-af11-4816-a11e-1f0198ad1fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60043f5f-94f5-4395-a0ab-ea907208e51e', 'volume_name': 'volume-60043f5f-94f5-4395-a0ab-ea907208e51e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b628476-9ca2-4bd3-a69b-047ac562f94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b628476-9ca2-4bd3-a69b-047ac562f94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2869e7-6454-420a-b964-c86f9cc36666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:18 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Volume 60043f5f-94f5-4395-a0ab-ea907208e51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60043f5f-94f5-4395-a0ab-ea907208e51e', 'volume_size': 1}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739115564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60043f5f-94f5-4395-a0ab-ea907208e51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3c0ed7bc5841beaf944ae1b7ed0437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:11:19Z,use_quota=True,user_id='8d3affeda7d2484e9982ddbdd9c030ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Creating volume 60043f5f-94f5-4395-a0ab-ea907208e51e {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:11:18 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:11:18 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:18 devstack sudo[106859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e 1073741824
Jul 14 18:11:18 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:19 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e 1073741824" returned: 0 in 0.384s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:19 devstack sudo[106865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e
Jul 14 18:11:19 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:19 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e" returned: 0 in 0.238s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2869e7-6454-420a-b964-c86f9cc36666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60043f5f-94f5-4395-a0ab-ea907208e51e', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6bc4bb-ab3f-40aa-884b-3d8e7590a98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:19 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Volume volume-60043f5f-94f5-4395-a0ab-ea907208e51e (60043f5f-94f5-4395-a0ab-ea907208e51e): created successfully
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6bc4bb-ab3f-40aa-884b-3d8e7590a98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Flow 'volume_create_manager' (5ed6185e-d986-446b-a8f2-bd8a2b641a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:11:19 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9b4936e8-4ee3-47da-bcad-7f0ae4817a99 tempest-ProjectReaderTests-2070842488 None] Created volume successfully.
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] Creating offline snapshot 38cb955b-db8d-4b71-83d0-9684451033c5 of volume 60043f5f-94f5-4395-a0ab-ea907208e51e {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[949b5285-a66d-46e5-aeaa-6a0e7e796585]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:19 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:20 devstack sudo[106869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e
Jul 14 18:11:20 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:20 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e" returned: 0 in 0.335s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:20 devstack sudo[106874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5 1G
Jul 14 18:11:20 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:20 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5 1G" returned: 0 in 0.366s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60043f5f-94f5-4395-a0ab-ea907208e51e -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:20 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60043f5f-94f5-4395-a0ab-ea907208e51e -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5
Jul 14 18:11:20 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:20 devstack sudo[106881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:11:20 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:20 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60043f5f-94f5-4395-a0ab-ea907208e51e -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5" returned: 0 in 0.300s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:20 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5 is being set with open permissions: ugo+rw
Jul 14 18:11:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:21 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5
Jul 14 18:11:21 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:21 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.246s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:11:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:11:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:11:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:11:21 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5" returned: 0 in 0.239s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:21 devstack sudo[106890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.info
Jul 14 18:11:21 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:21 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.info" returned: 0 in 0.244s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:21 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.info is being set with open permissions: ugo+rw
Jul 14 18:11:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:21 devstack sudo[106893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.info
Jul 14 18:11:21 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:21 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.info" returned: 0 in 0.229s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.796s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:21 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-7ebd008c-83fb-4328-a660-59f9a11b8bac tempest-ProjectReaderTests-2070842488 None] Create snapshot completed successfully
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-38cb955b-db8d-4b71-83d0-9684451033c5-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Lock "cinder-38cb955b-db8d-4b71-83d0-9684451033c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-60043f5f-94f5-4395-a0ab-ea907208e51e" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-60043f5f-94f5-4395-a0ab-ea907208e51e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-38cb955b-db8d-4b71-83d0-9684451033c5" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-38cb955b-db8d-4b71-83d0-9684451033c5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Deleting offline snapshot 38cb955b-db8d-4b71-83d0-9684451033c5 of volume 60043f5f-94f5-4395-a0ab-ea907208e51e {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] snapshot_file for this snap is: volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5326fcf-8a7e-451b-9289-59cab16ba748]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:22 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5
Jul 14 18:11:22 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:22 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5" returned: 0 in 0.342s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60043f5f-94f5-4395-a0ab-ea907208e51e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd28e9ac-744e-49c3-96d3-346f1f244468]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:22 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e
Jul 14 18:11:22 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:22 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:22 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:22 devstack sudo[106906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5
Jul 14 18:11:22 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:23 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5" returned: 0 in 0.316s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:23 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5
Jul 14 18:11:23 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:23 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:23 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e.38cb955b-db8d-4b71-83d0-9684451033c5" returned: 0 in 0.242s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-38cb955b-db8d-4b71-83d0-9684451033c5" released by "_delete_snapshot" :: held 1.326s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-60043f5f-94f5-4395-a0ab-ea907208e51e" released by "delete_snapshot" :: held 1.345s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:23 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Created reservations ['f5f0fef4-c777-45d2-a71a-f226ffaddac7', '70da6955-58ee-422c-8042-8d3b106ac434', '2abb4f4d-ed21-4b0f-a563-82911979193c', 'c23cf6c0-9f19-46bc-9ce9-3ee3a5dfdc83'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:11:23 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Delete snapshot completed successfully.
Jul 14 18:11:23 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a410ed52-f8a2-4922-a398-58d86b38f09c tempest-ProjectReaderTests-2070842488 None] Lock "cinder-38cb955b-db8d-4b71-83d0-9684451033c5-delete_snapshot" released by "delete_snapshot" :: held 1.471s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-60043f5f-94f5-4395-a0ab-ea907208e51e-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Lock "cinder-60043f5f-94f5-4395-a0ab-ea907208e51e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-60043f5f-94f5-4395-a0ab-ea907208e51e" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-60043f5f-94f5-4395-a0ab-ea907208e51e" acquired by "delete_volume" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:24 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[30916bc4-d401-477e-9efe-0af474724a85]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:24 devstack sudo[106914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e
Jul 14 18:11:24 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:24 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e" returned: 0 in 0.337s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:24 devstack sudo[106919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e
Jul 14 18:11:24 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:24 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:24 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-60043f5f-94f5-4395-a0ab-ea907208e51e" returned: 0 in 0.233s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:24 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-60043f5f-94f5-4395-a0ab-ea907208e51e" released by "delete_volume" :: held 0.625s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:24 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Created reservations ['570da4f6-9cd1-4d66-b93c-70e2b1b3b4f7', '4365c401-2c48-455d-adc3-3ce383107d14', 'b01c37a9-9850-4cc2-abc9-5f8860f78c54', 'abf238fc-956f-490f-9d7a-4e5afe351f01'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:25 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:11:25 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:25 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:11:25 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Deleted volume successfully.
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-9416bb2e-bd3d-4871-8daa-6c017f97f2cc tempest-ProjectReaderTests-2070842488 None] Lock "cinder-60043f5f-94f5-4395-a0ab-ea907208e51e-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Flow 'volume_create_manager' (c260e2d7-dc91-4537-bdbc-711bc8d3a5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ae0f14-8707-4e0b-8eb4-f5d33cfcd834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ae0f14-8707-4e0b-8eb4-f5d33cfcd834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758361847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4729745-cd50-4f99-81fb-f148ca241c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3c0ed7bc5841beaf944ae1b7ed0437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:11:26Z,use_quota=True,user_id='8d3affeda7d2484e9982ddbdd9c030ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27169da5-61fa-420d-af3f-88467e37b037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27169da5-61fa-420d-af3f-88467e37b037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33a46d9-8269-41ff-8a6e-eed39d59c64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33a46d9-8269-41ff-8a6e-eed39d59c64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4729745-cd50-4f99-81fb-f148ca241c1b', 'volume_name': 'volume-b4729745-cd50-4f99-81fb-f148ca241c1b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcc3443-b205-4c6a-a9dc-b4deaf3bff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcc3443-b205-4c6a-a9dc-b4deaf3bff1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785f9d7e-7b18-434b-a5a2-5405bd847ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:25 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Volume b4729745-cd50-4f99-81fb-f148ca241c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4729745-cd50-4f99-81fb-f148ca241c1b', 'volume_size': 1}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758361847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4729745-cd50-4f99-81fb-f148ca241c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3c0ed7bc5841beaf944ae1b7ed0437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:11:26Z,use_quota=True,user_id='8d3affeda7d2484e9982ddbdd9c030ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Creating volume b4729745-cd50-4f99-81fb-f148ca241c1b {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:11:25 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:11:25 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:25 devstack sudo[106925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b 1073741824
Jul 14 18:11:25 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:26 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b 1073741824" returned: 0 in 0.383s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:26 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b
Jul 14 18:11:26 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:26 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:11:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785f9d7e-7b18-434b-a5a2-5405bd847ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4729745-cd50-4f99-81fb-f148ca241c1b', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210c9b54-0cf9-4829-8fae-7a0431a851ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:26 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Volume volume-b4729745-cd50-4f99-81fb-f148ca241c1b (b4729745-cd50-4f99-81fb-f148ca241c1b): created successfully
Jul 14 18:11:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210c9b54-0cf9-4829-8fae-7a0431a851ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:26 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Flow 'volume_create_manager' (c260e2d7-dc91-4537-bdbc-711bc8d3a5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:11:26 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2351ba76-1ab3-44a6-952f-42288fee58bc tempest-ProjectReaderTests-2070842488 None] Created volume successfully.
Jul 14 18:11:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:26 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:26 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] Creating offline snapshot 6c188510-daaf-4ee7-bac4-e8dbe4ce882b of volume b4729745-cd50-4f99-81fb-f148ca241c1b {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:11:27 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0039c499-44c8-44f9-8ab5-037d2f159f0d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:27 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b
Jul 14 18:11:27 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:27 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b" returned: 0 in 0.342s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:27 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b 1G
Jul 14 18:11:27 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:27 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b 1G" returned: 0 in 0.371s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:27 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4729745-cd50-4f99-81fb-f148ca241c1b -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:27 devstack sudo[106944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4729745-cd50-4f99-81fb-f148ca241c1b -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b
Jul 14 18:11:27 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:28 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4729745-cd50-4f99-81fb-f148ca241c1b -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b" returned: 0 in 0.294s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:28 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b is being set with open permissions: ugo+rw
Jul 14 18:11:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:28 devstack sudo[106950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b
Jul 14 18:11:28 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:28 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b" returned: 0 in 0.243s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:28 devstack sudo[106953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.info
Jul 14 18:11:28 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:28 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.info" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:28 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.info is being set with open permissions: ugo+rw
Jul 14 18:11:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:28 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.info
Jul 14 18:11:28 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:28 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.info" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:28 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:28 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-31d67f2a-030e-41d5-8539-6506f7dad8cd tempest-ProjectReaderTests-2070842488 None] Create snapshot completed successfully
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-6c188510-daaf-4ee7-bac4-e8dbe4ce882b-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-6c188510-daaf-4ee7-bac4-e8dbe4ce882b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-b4729745-cd50-4f99-81fb-f148ca241c1b" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-b4729745-cd50-4f99-81fb-f148ca241c1b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-6c188510-daaf-4ee7-bac4-e8dbe4ce882b" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-6c188510-daaf-4ee7-bac4-e8dbe4ce882b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Deleting offline snapshot 6c188510-daaf-4ee7-bac4-e8dbe4ce882b of volume b4729745-cd50-4f99-81fb-f148ca241c1b {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] snapshot_file for this snap is: volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d89612-4551-4e40-94c5-879bfb8871e2]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:29 devstack sudo[106959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b
Jul 14 18:11:29 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:29 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b" returned: 0 in 0.356s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4729745-cd50-4f99-81fb-f148ca241c1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d6bf99-e8a3-4308-9c0a-5201dee69dd3]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:29 devstack sudo[106964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b
Jul 14 18:11:29 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:29 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b" returned: 0 in 0.342s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:29 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:29 devstack sudo[106970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b
Jul 14 18:11:29 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:30 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b" returned: 0 in 0.316s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:30 devstack sudo[106975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b
Jul 14 18:11:30 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:30 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:30 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b.6c188510-daaf-4ee7-bac4-e8dbe4ce882b" returned: 0 in 0.232s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-6c188510-daaf-4ee7-bac4-e8dbe4ce882b" released by "_delete_snapshot" :: held 1.333s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-b4729745-cd50-4f99-81fb-f148ca241c1b" released by "delete_snapshot" :: held 1.355s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:30 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Created reservations ['2d7ca16e-0167-43a6-b0a9-e9c3695dfc9f', 'caa3d85b-c0e0-4aa6-a99a-140a8bb1d7c9', '975fbf43-0889-4934-b3ab-3742f2c7e65b', 'd822cdb4-182b-4779-902f-1e9e01411b27'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:11:30 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Delete snapshot completed successfully.
Jul 14 18:11:30 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-b0834fec-8143-4ee0-9830-882e95ed1ea7 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-6c188510-daaf-4ee7-bac4-e8dbe4ce882b-delete_snapshot" released by "delete_snapshot" :: held 1.482s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-b4729745-cd50-4f99-81fb-f148ca241c1b-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-b4729745-cd50-4f99-81fb-f148ca241c1b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-b4729745-cd50-4f99-81fb-f148ca241c1b" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-b4729745-cd50-4f99-81fb-f148ca241c1b" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:31 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6f79f9-10bc-473f-8708-418e32cafd85]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:31 devstack sudo[106978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b
Jul 14 18:11:31 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:31 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b" returned: 0 in 0.351s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:31 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b
Jul 14 18:11:31 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:31 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:31 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-b4729745-cd50-4f99-81fb-f148ca241c1b" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:31 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-b4729745-cd50-4f99-81fb-f148ca241c1b" released by "delete_volume" :: held 0.653s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Created reservations ['ef66d8b3-d667-4f40-90ae-9616a09ed045', 'c4567163-7df0-475b-9a0f-64e024918be8', 'df5ebf4f-3214-4fd3-ad32-fb9aaa5ccaa7', 'd8922acb-7037-410b-b543-f6ad17fdee76'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:32 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:11:32 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:32 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.232s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:11:32 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Deleted volume successfully.
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-21936d46-f747-4c59-b632-dbe56be0e636 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-b4729745-cd50-4f99-81fb-f148ca241c1b-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Flow 'volume_create_manager' (69b4c7bf-e892-4568-a077-6f09c4e7248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85274e66-4671-4556-b4ca-16cce89c9629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85274e66-4671-4556-b4ca-16cce89c9629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-442462508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a5d45e0-07c6-477c-a3e2-cbf54aee31d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3c0ed7bc5841beaf944ae1b7ed0437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:11:33Z,use_quota=True,user_id='8d3affeda7d2484e9982ddbdd9c030ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6bd7be-84bd-435f-aedb-3b33fa28e432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6bd7be-84bd-435f-aedb-3b33fa28e432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cd2bf5-aa75-4434-ab2b-833aaa562d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cd2bf5-aa75-4434-ab2b-833aaa562d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a5d45e0-07c6-477c-a3e2-cbf54aee31d8', 'volume_name': 'volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949bd076-09a1-49c8-b8b8-2f66b7c00f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949bd076-09a1-49c8-b8b8-2f66b7c00f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a5693c-4d71-4ec0-beb9-89676a626724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:32 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Volume 2a5d45e0-07c6-477c-a3e2-cbf54aee31d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8', 'volume_size': 1}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-442462508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a5d45e0-07c6-477c-a3e2-cbf54aee31d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3c0ed7bc5841beaf944ae1b7ed0437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:11:33Z,use_quota=True,user_id='8d3affeda7d2484e9982ddbdd9c030ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Creating volume 2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:11:32 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:11:32 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:32 devstack sudo[106989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 1073741824
Jul 14 18:11:32 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:33 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 1073741824" returned: 0 in 0.385s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:33 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8
Jul 14 18:11:33 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:33 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:33 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:11:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a5693c-4d71-4ec0-beb9-89676a626724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee138da-f640-450e-ad7c-1cb2715cfc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:11:33 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Volume volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 (2a5d45e0-07c6-477c-a3e2-cbf54aee31d8): created successfully
Jul 14 18:11:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee138da-f640-450e-ad7c-1cb2715cfc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:11:33 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Flow 'volume_create_manager' (69b4c7bf-e892-4568-a077-6f09c4e7248f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:11:33 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-bcfcdfe1-3d8f-4755-8ca2-d0abfcc95654 tempest-ProjectReaderTests-2070842488 None] Created volume successfully.
Jul 14 18:11:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:33 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:34 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] Creating offline snapshot 8bc36b81-8005-4725-8336-2da9f5844183 of volume 2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:11:34 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f084c7-a8b9-48ca-9952-4528d4932330]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:34 devstack sudo[106998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8
Jul 14 18:11:34 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:34 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8" returned: 0 in 0.339s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:34 devstack sudo[107003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183 1G
Jul 14 18:11:34 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:34 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183 1G" returned: 0 in 0.383s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:34 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:34 devstack sudo[107008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183
Jul 14 18:11:34 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:35 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183" returned: 0 in 0.286s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:35 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183 is being set with open permissions: ugo+rw
Jul 14 18:11:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:35 devstack sudo[107013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183
Jul 14 18:11:35 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:35 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183" returned: 0 in 0.231s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:35 devstack sudo[107016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.info
Jul 14 18:11:35 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:35 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.info" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:35 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.info is being set with open permissions: ugo+rw
Jul 14 18:11:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:35 devstack sudo[107019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.info
Jul 14 18:11:35 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:35 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.info" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:35 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.786s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:35 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-be593d40-0222-4cc7-97cc-7296abf07834 tempest-ProjectReaderTests-2070842488 None] Create snapshot completed successfully
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-8bc36b81-8005-4725-8336-2da9f5844183-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-8bc36b81-8005-4725-8336-2da9f5844183-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-8bc36b81-8005-4725-8336-2da9f5844183" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-8bc36b81-8005-4725-8336-2da9f5844183" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Deleting offline snapshot 8bc36b81-8005-4725-8336-2da9f5844183 of volume 2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] snapshot_file for this snap is: volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba930be-ecd2-43ab-ac14-cffb6029415d]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:36 devstack sudo[107022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183
Jul 14 18:11:36 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:36 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183" returned: 0 in 0.355s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc20b46d-9808-466e-bef1-de9ab26c1a85]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:36 devstack sudo[107027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8
Jul 14 18:11:36 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:36 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8" returned: 0 in 0.345s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:36 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:36 devstack sudo[107032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183
Jul 14 18:11:36 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:37 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183" returned: 0 in 0.328s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:37 devstack sudo[107037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183
Jul 14 18:11:37 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:37 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:37 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8.8bc36b81-8005-4725-8336-2da9f5844183" returned: 0 in 0.229s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-8bc36b81-8005-4725-8336-2da9f5844183" released by "_delete_snapshot" :: held 1.344s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8" released by "delete_snapshot" :: held 1.365s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:37 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Created reservations ['9c5e77bf-444f-46ce-88c0-4aeda065191b', '9ea148d4-64e6-4443-8593-9bbc61e4f0ac', '39c26cbe-fe58-4df5-a38b-67a0530a1200', 'c2c9c998-872b-4231-a283-b3303f105241'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:11:37 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Delete snapshot completed successfully.
Jul 14 18:11:37 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-76b1e1e6-1c91-4d83-86ac-875e796f7938 tempest-ProjectReaderTests-2070842488 None] Lock "cinder-8bc36b81-8005-4725-8336-2da9f5844183-delete_snapshot" released by "delete_snapshot" :: held 1.495s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Lock "cinder-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Acquiring lock "cinder-quobyte-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:11:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8" acquired by "delete_volume" :: waited 0.016s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:11:38 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6e7d84-a81b-49a0-9d8c-693b8028816b]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:11:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:38 devstack sudo[107040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8
Jul 14 18:11:38 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:38 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8" returned: 0 in 0.344s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:38 devstack sudo[107045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8
Jul 14 18:11:38 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:38 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:38 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8" returned: 0 in 0.233s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:38 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Lock "cinder-quobyte-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8" released by "delete_volume" :: held 0.638s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:39 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Created reservations ['13a7b6a9-ef80-4cc0-a89d-6224da236b08', '8c85c937-1837-4d00-90f9-961b20138450', '53838039-550c-41d2-8f3b-aca282cf9beb', 'a8c5b223-1928-4402-a69b-7fb2e8f76c70'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:11:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:11:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:11:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:11:39 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:11:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:11:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:11:39 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:11:39 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:11:39 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Jul 14 18:11:39 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.225s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:11:39 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:11:39 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Deleted volume successfully.
Jul 14 18:11:39 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-c4cc7059-22be-41d5-a221-28b754fd793a tempest-ProjectReaderTests-2070842488 None] Lock "cinder-2a5d45e0-07c6-477c-a3e2-cbf54aee31d8-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:11:49 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=98,cinder:DELETE=11,cinder:INSERT=35,cinder:UPDATE=123 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:11:49 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=104,cinder:INSERT=30,cinder:SELECT=79,cinder:DELETE=9 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Flow 'volume_create_manager' (052bb848-e408-4e0d-ac90-35971ac2b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cf2b80-3cdb-4394-a699-3776637bb0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cf2b80-3cdb-4394-a699-3776637bb0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2042301238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd36592b-52b0-46f9-891b-72be92693f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea304464629e4b8786557ebb7e568a0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:12:00Z,use_quota=True,user_id='016ba01d64c447499f91b76ec4c23b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf054ff-3063-4cea-a084-c13353b956f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf054ff-3063-4cea-a084-c13353b956f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2bed5e-ed86-4ac6-ba4d-4862ff7aef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2bed5e-ed86-4ac6-ba4d-4862ff7aef09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd36592b-52b0-46f9-891b-72be92693f99', 'volume_name': 'volume-dd36592b-52b0-46f9-891b-72be92693f99', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24774b5c-3d39-4bcd-96cb-2d34b1620ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24774b5c-3d39-4bcd-96cb-2d34b1620ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c1e0ba-1a22-4cd6-854a-70487be564af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:12:00 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Volume dd36592b-52b0-46f9-891b-72be92693f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd36592b-52b0-46f9-891b-72be92693f99', 'volume_size': 1}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70a2cab1a6c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2042301238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd36592b-52b0-46f9-891b-72be92693f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea304464629e4b8786557ebb7e568a0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:12:00Z,use_quota=True,user_id='016ba01d64c447499f91b76ec4c23b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)}" {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Creating volume dd36592b-52b0-46f9-891b-72be92693f99 {{(pid=87401) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:12:00 devstack cinder-volume[87401]: INFO cinder.volume.drivers.remotefs [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] casted to osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 1073741824 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:00 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 1073741824
Jul 14 18:12:00 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:00 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 1073741824" returned: 0 in 0.405s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:00 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:00 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99
Jul 14 18:12:00 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:01 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99" returned: 0 in 0.242s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'} {{(pid=87401) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 18:12:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:12:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c1e0ba-1a22-4cd6-854a-70487be564af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd36592b-52b0-46f9-891b-72be92693f99', 'volume_size': 1}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:12:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc4c9fa-31bf-4b08-a6b4-93ab6af93fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:12:01 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Volume volume-dd36592b-52b0-46f9-891b-72be92693f99 (dd36592b-52b0-46f9-891b-72be92693f99): created successfully
Jul 14 18:12:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc4c9fa-31bf-4b08-a6b4-93ab6af93fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:12:01 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Flow 'volume_create_manager' (052bb848-e408-4e0d-ac90-35971ac2b547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:12:01 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-950079b1-ecfe-4628-a1d4-730d433bb7d8 tempest-SnapshotDependencyTests-1600629476 None] Created volume successfully.
Jul 14 18:12:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:12:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:12:01 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] Creating offline snapshot 2409d6fa-f41e-4936-8103-b9ddb0f9aaec of volume dd36592b-52b0-46f9-891b-72be92693f99 {{(pid=87401) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 18:12:01 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[09125200-3ffc-4b17-844a-c8a8aed14198]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:12:01 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:01 devstack sudo[107107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99
Jul 14 18:12:01 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:02 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99" returned: 0 in 0.365s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec 1G {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:02 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec 1G
Jul 14 18:12:02 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:02 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec 1G" returned: 0 in 0.454s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd36592b-52b0-46f9-891b-72be92693f99 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:02 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd36592b-52b0-46f9-891b-72be92693f99 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec
Jul 14 18:12:02 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:02 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd36592b-52b0-46f9-891b-72be92693f99 -F qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec" returned: 0 in 0.286s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:02 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec is being set with open permissions: ugo+rw
Jul 14 18:12:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:02 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec
Jul 14 18:12:02 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:02 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:02 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec" returned: 0 in 0.234s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:03 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.info
Jul 14 18:12:03 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:03 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.info" returned: 0 in 0.238s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:03 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.info is being set with open permissions: ugo+rw
Jul 14 18:12:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.info {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:03 devstack sudo[107129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.info
Jul 14 18:12:03 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:03 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.info" returned: 0 in 0.235s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:03 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:12:03 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-dbd81999-e9b9-45ba-890d-4d7c1580efe0 tempest-SnapshotDependencyTests-1600629476 None] Create snapshot completed successfully
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.flows.manager.create_volume [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87401) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Flow 'volume_create_manager' (41ee6d1a-1f50-4fe9-97c7-fafc8c8a8b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62011563-6a47-42c3-a53d-b2b448c926cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62011563-6a47-42c3-a53d-b2b448c926cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T16:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e87e341-6468-4d0a-94d4-cded3c88fd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea304464629e4b8786557ebb7e568a0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T16:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2409d6fa-f41e-4936-8103-b9ddb0f9aaec,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T16:12:04Z,use_quota=True,user_id='016ba01d64c447499f91b76ec4c23b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1da68c5-83a2-4493-b46c-4e0d51f3f421),volume_type_id=e1da68c5-83a2-4493-b46c-4e0d51f3f421)' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2324b523-c37c-4624-a886-e589b9bf15e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2324b523-c37c-4624-a886-e589b9bf15e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9102e948-0f1c-4f0e-bb0f-5854ec46947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9102e948-0f1c-4f0e-bb0f-5854ec46947b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e87e341-6468-4d0a-94d4-cded3c88fd10', 'volume_name': 'volume-8e87e341-6468-4d0a-94d4-cded3c88fd10', 'volume_size': 1, 'snapshot_id': '2409d6fa-f41e-4936-8103-b9ddb0f9aaec'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf695f0-0214-4806-8e90-c2dd04070efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf695f0-0214-4806-8e90-c2dd04070efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7450b9-6118-4471-b6d2-effa59262c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:12:04 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Volume 8e87e341-6468-4d0a-94d4-cded3c88fd10: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e87e341-6468-4d0a-94d4-cded3c88fd10', 'volume_size': 1, 'snapshot_id': '2409d6fa-f41e-4936-8103-b9ddb0f9aaec'}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "cinder-quobyte-2409d6fa-f41e-4936-8103-b9ddb0f9aaec-8e87e341-6468-4d0a-94d4-cded3c88fd10" by "_create_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-quobyte-2409d6fa-f41e-4936-8103-b9ddb0f9aaec-8e87e341-6468-4d0a-94d4-cded3c88fd10" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Creating volume 8e87e341-6468-4d0a-94d4-cded3c88fd10 from snapshot 2409d6fa-f41e-4936-8103-b9ddb0f9aaec {{(pid=87401) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Selected osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b as target Quobyte volume. {{(pid=87401) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "cinder-quobyte-8e87e341-6468-4d0a-94d4-cded3c88fd10" by "_copy_volume_from_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-quobyte-8e87e341-6468-4d0a-94d4-cded3c88fd10" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] snapshot: 2409d6fa-f41e-4936-8103-b9ddb0f9aaec, volume: 8e87e341-6468-4d0a-94d4-cded3c88fd10,  {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f4a2cb-ba35-4160-add9-b4459be366d1]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:04 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec
Jul 14 18:12:04 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:04 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec" returned: 0 in 0.350s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd36592b-52b0-46f9-891b-72be92693f99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] will copy from snapshot at /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Creating direct copy from snapshot {{(pid=87401) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1413f5-3374-4151-9393-f2d6c996c0dc]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:12:04 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:04 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99
Jul 14 18:12:04 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:05 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99" returned: 0 in 0.336s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:05 devstack cinder-volume[87401]: DEBUG cinder.utils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Path /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10 not found in is_blk_device check {{(pid=87401) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 18:12:05 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:05 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10
Jul 14 18:12:05 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:08 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10" returned: 0 in 3.701s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:08 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a4d666-87e4-4e74-984e-1a11c282ed11]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:12:08 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:08 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99
Jul 14 18:12:08 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:09 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99" returned: 0 in 0.497s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.image.image_utils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Image conversion details: src /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99, size 1024.00 MB, duration 3.70 sec, destination /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10 {{(pid=87401) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 18:12:09 devstack cinder-volume[87401]: INFO cinder.image.image_utils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Converted 1024.00 MB image at 276.59 MB/s
Jul 14 18:12:09 devstack cinder-volume[87401]: WARNING cinder.volume.drivers.remotefs [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10 is being set with open permissions: ugo+rw
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:09 devstack sudo[107160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10
Jul 14 18:12:09 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:09 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10" returned: 0 in 0.228s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-quobyte-8e87e341-6468-4d0a-94d4-cded3c88fd10" released by "_copy_volume_from_snapshot" :: held 5.191s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-quobyte-2409d6fa-f41e-4936-8103-b9ddb0f9aaec-8e87e341-6468-4d0a-94d4-cded3c88fd10" released by "_create_volume_from_snapshot" :: held 5.220s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.234s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7450b9-6118-4471-b6d2-effa59262c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e87e341-6468-4d0a-94d4-cded3c88fd10', 'volume_size': 1, 'snapshot_id': '2409d6fa-f41e-4936-8103-b9ddb0f9aaec'}' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7629fe0-23a3-46b7-82e8-c12e47aa8d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 18:12:09 devstack cinder-volume[87401]: INFO cinder.volume.flows.manager.create_volume [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Volume volume-8e87e341-6468-4d0a-94d4-cded3c88fd10 (8e87e341-6468-4d0a-94d4-cded3c88fd10): created successfully
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7629fe0-23a3-46b7-82e8-c12e47aa8d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87401) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Flow 'volume_create_manager' (41ee6d1a-1f50-4fe9-97c7-fafc8c8a8b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87401) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 18:12:09 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-a345d4a4-d023-448c-b267-d5f5ab59e97b tempest-SnapshotDependencyTests-1600629476 None] Created volume successfully.
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "cinder-2409d6fa-f41e-4936-8103-b9ddb0f9aaec-delete_snapshot" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-2409d6fa-f41e-4936-8103-b9ddb0f9aaec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "cinder-quobyte-dd36592b-52b0-46f9-891b-72be92693f99" by "delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-quobyte-dd36592b-52b0-46f9-891b-72be92693f99" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "cinder-quobyte-2409d6fa-f41e-4936-8103-b9ddb0f9aaec" by "_delete_snapshot" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-quobyte-2409d6fa-f41e-4936-8103-b9ddb0f9aaec" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Deleting offline snapshot 2409d6fa-f41e-4936-8103-b9ddb0f9aaec of volume dd36592b-52b0-46f9-891b-72be92693f99 {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] snapshot_file for this snap is: volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec {{(pid=87401) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f79847-3306-47ff-a12c-65fc43366865]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:12:09 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:09 devstack sudo[107163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec
Jul 14 18:12:09 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:10 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec" returned: 0 in 0.350s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:10 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.remotefs [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd36592b-52b0-46f9-891b-72be92693f99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87401) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 18:12:10 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c754a99-4d5a-4493-b6c8-7f3ae67ae954]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:12:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:10 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99
Jul 14 18:12:10 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:10 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99" returned: 0 in 0.342s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:10 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec
Jul 14 18:12:10 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:10 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec" returned: 0 in 0.315s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:10 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:10 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec
Jul 14 18:12:10 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:11 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:11 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99.2409d6fa-f41e-4936-8103-b9ddb0f9aaec" returned: 0 in 0.246s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-quobyte-2409d6fa-f41e-4936-8103-b9ddb0f9aaec" released by "_delete_snapshot" :: held 1.341s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:12:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-quobyte-dd36592b-52b0-46f9-891b-72be92693f99" released by "delete_snapshot" :: held 1.361s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:12:11 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Created reservations ['cd985afc-44c5-4a97-b59b-32400e92e8d1', 'aab50ec3-0c28-4c88-a103-0f3edcf02ceb', 'e857ddd2-4939-4da2-aa70-d5ebbc0884d8', '12f3787d-a75e-4644-a01f-feb0712dffb0'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:12:11 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Delete snapshot completed successfully.
Jul 14 18:12:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-d0d404a2-c61f-4b53-b4a9-5ed098a50413 tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-2409d6fa-f41e-4936-8103-b9ddb0f9aaec-delete_snapshot" released by "delete_snapshot" :: held 1.484s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:12:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "cinder-dd36592b-52b0-46f9-891b-72be92693f99-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:12:11 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-dd36592b-52b0-46f9-891b-72be92693f99-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "cinder-quobyte-dd36592b-52b0-46f9-891b-72be92693f99" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-quobyte-dd36592b-52b0-46f9-891b-72be92693f99" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64b9692-3397-4d98-9933-85671050d7bd]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:12 devstack sudo[107183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99
Jul 14 18:12:12 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:12 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99" returned: 0 in 0.349s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:12 devstack sudo[107188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99
Jul 14 18:12:12 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:12 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-dd36592b-52b0-46f9-891b-72be92693f99" returned: 0 in 0.236s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-quobyte-dd36592b-52b0-46f9-891b-72be92693f99" released by "delete_volume" :: held 0.640s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Created reservations ['d7717e84-fb6f-408c-9b68-e6200b80b659', 'b30edf0a-f0da-4002-9d4d-1de5572fc90d', '3498a0ac-bf3b-4571-b246-98ed8455a1c8', '3dff353e-596f-4e22-8cda-9f22b6144067'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:12 devstack sudo[107191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:12:12 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:12 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.226s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:12 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:12:13 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Deleted volume successfully.
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-2bce4442-9b1d-4164-93ed-9e1528e89eb3 tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-dd36592b-52b0-46f9-891b-72be92693f99-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "cinder-8e87e341-6468-4d0a-94d4-cded3c88fd10-delete_volume" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-8e87e341-6468-4d0a-94d4-cded3c88fd10-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "cinder-quobyte-8e87e341-6468-4d0a-94d4-cded3c88fd10" by "delete_volume" {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-quobyte-8e87e341-6468-4d0a-94d4-cded3c88fd10" acquired by "delete_volume" :: waited 0.014s {{(pid=87401) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b60171e-8d23-4711-af52-a5b480754ce8]: (4, 'qcow2') {{(pid=88276) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:13 devstack sudo[107194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10
Jul 14 18:12:13 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:13 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10" returned: 0 in 0.338s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:13 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10
Jul 14 18:12:13 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:13 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499/volume-8e87e341-6468-4d0a-94d4-cded3c88fd10" returned: 0 in 0.233s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-quobyte-8e87e341-6468-4d0a-94d4-cded3c88fd10" released by "delete_volume" :: held 0.606s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG cinder.quota [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Created reservations ['df05ce41-d92d-437c-9c32-f142793a8ce2', '5fe73ec5-e79d-4871-a020-a576e10f7386', '544a0ea5-36e5-485d-b915-a62fda0c7854', 'f038be1a-ae5a-4bbc-b3e5-2ff59132f4b5'] {{(pid=87401) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:12:13 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:13 devstack sudo[107202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:12:13 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:14 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:14 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.230s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:14 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:12:14 devstack cinder-volume[87401]: INFO cinder.volume.manager [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Deleted volume successfully.
Jul 14 18:12:14 devstack cinder-volume[87401]: DEBUG cinder.coordination [None req-742a708c-2b7c-4ac1-9f6c-b9cc9701422e tempest-SnapshotDependencyTests-1600629476 None] Lock "cinder-8e87e341-6468-4d0a-94d4-cded3c88fd10-delete_volume" released by "delete_volume" :: held 1.019s {{(pid=87401) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 18:12:20 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:12:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 18:12:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 18:12:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b': None} {{(pid=87401) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 18:12:20 devstack cinder-volume[87401]: DEBUG cinder.volume.drivers.quobyte [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ad088837-c669-45e2-8f5c-fa2001703a0b'] {{(pid=87401) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 18:12:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.lockutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87401) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 18:12:20 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499 {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 18:12:20 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499
Jul 14 18:12:20 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 18:12:21 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Jul 14 18:12:21 devstack cinder-volume[87401]: DEBUG oslo_concurrency.processutils [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/69e779168b02499bd26595330392e499" returned: 0 in 0.250s {{(pid=87401) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 18:12:21 devstack cinder-volume[87401]: DEBUG cinder.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Notifying Schedulers of capabilities ... {{(pid=87401) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 18:12:21 devstack cinder-volume[87401]: DEBUG oslo_service.periodic_task [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] Running periodic task VolumeManager._thread_info {{(pid=87401) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 18:12:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread count: 28 {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 18:12:21 devstack cinder-volume[87401]: DEBUG cinder.volume.manager [None req-5443c409-43db-4aaf-8099-63a1b5d6afd9 None None] thread info: [<_MainThread(MainThread, started 123844598841472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123844491206272)>, <Thread(Thread-3 (stat_writer), started daemon 123844486620544)>, <Thread(Rabbit-heartbeat, started daemon 123844487403584)>, <Thread(Thread-5 (_runner), started daemon 123844485460800)>, <Thread(Thread-7 (_runner), started daemon 123844485477056)>, <Thread(fd_logger, started daemon 123844484101440)>, <Thread(privsep_reader, started daemon 123844482046400)>, <Thread(tpool_thread_0, started daemon 123844476778176)>, <Thread(tpool_thread_1, started daemon 123844468385472)>, <Thread(tpool_thread_2, started daemon 123844459992768)>, <Thread(tpool_thread_3, started daemon 123844451600064)>, <Thread(tpool_thread_4, started daemon 123844443207360)>, <Thread(tpool_thread_5, started daemon 123844434814656)>, <Thread(tpool_thread_6, started daemon 123844426405568)>, <Thread(tpool_thread_7, started daemon 123844417996480)>, <Thread(tpool_thread_8, started daemon 123844409587392)>, <Thread(tpool_thread_9, started daemon 123844401178304)>, <Thread(tpool_thread_10, started daemon 123844392769216)>, <Thread(tpool_thread_11, started daemon 123844384360128)>, <Thread(tpool_thread_12, started daemon 123844375951040)>, <Thread(tpool_thread_13, started daemon 123844367541952)>, <Thread(tpool_thread_14, started daemon 123844359132864)>, <Thread(tpool_thread_15, started daemon 123844350723776)>, <Thread(tpool_thread_16, started daemon 123844342314688)>, <Thread(tpool_thread_17, started daemon 123844333905600)>, <Thread(tpool_thread_18, started daemon 123844325496512)>, <Thread(tpool_thread_19, started daemon 123844317087424)>] {{(pid=87401) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 18:12:23 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:SELECT=25,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 18:12:24 devstack cinder-volume[87401]: DEBUG dbcounter [-] [87401] Writing DB stats cinder:UPDATE=28,cinder:SELECT=22,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87401) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}